Apr 11 21:45:40 user nova-compute[71364]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 11 21:45:42 user nova-compute[71364]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71364) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 21:45:42 user nova-compute[71364]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71364) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 21:45:42 user nova-compute[71364]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71364) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 11 21:45:42 user nova-compute[71364]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 11 21:45:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:45:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:45:43 user nova-compute[71364]: INFO nova.virt.driver [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 11 21:45:43 user nova-compute[71364]: INFO nova.compute.provider_config [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] Acquiring lock "singleton_lock" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] Acquired lock "singleton_lock" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] Releasing lock "singleton_lock" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] Full set of CONF: {{(pid=71364) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ******************************************************************************** {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] Configuration options gathered from: {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ================================================================================ {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] allow_resize_to_same_host      = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] arq_binding_timeout            = 300 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] backdoor_port                  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] backdoor_socket                = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] block_device_allocate_retries  = 300 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] block_device_allocate_retries_interval = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cert                           = self.pem {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] compute_monitors               = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] config_dir                     = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] config_drive_format            = iso9660 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] config_source                  = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] console_host                   = user {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] control_exchange               = nova {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cpu_allocation_ratio           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] daemon                         = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] debug                          = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] default_access_ip_network_name = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] default_availability_zone      = nova {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] default_ephemeral_format       = ext4 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] default_schedule_zone          = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] disk_allocation_ratio          = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] enable_new_services            = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] enabled_ssl_apis               = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] flat_injected                  = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] force_config_drive             = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] force_raw_images               = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] graceful_shutdown_timeout      = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] heal_instance_info_cache_interval = 60 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] host                           = user {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] instance_build_timeout         = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] instance_delete_interval       = 300 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] instance_name_template         = instance-%08x {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] instance_usage_audit           = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] instance_usage_audit_period    = month {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] internal_service_availability_zone = internal {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] key                            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] live_migration_retry_count     = 30 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] log_config_append              = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] log_dir                        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] log_file                       = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] log_options                    = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] log_rotate_interval            = 1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] log_rotate_interval_type       = days {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] log_rotation_type              = none {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] long_rpc_timeout               = 1800 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] max_concurrent_builds          = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] max_concurrent_live_migrations = 1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] max_concurrent_snapshots       = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] max_local_block_devices        = 3 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] max_logfile_count              = 30 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] max_logfile_size_mb            = 200 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] maximum_instance_delete_attempts = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] metadata_listen                = 0.0.0.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] metadata_listen_port           = 8775 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] metadata_workers               = 3 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] migrate_max_retries            = -1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] mkisofs_cmd                    = genisoimage {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] my_ip                          = 10.0.0.210 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] network_allocate_retries       = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] osapi_compute_listen_port      = 8774 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] osapi_compute_unique_server_name_scope =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] osapi_compute_workers          = 3 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] password_length                = 12 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] periodic_enable                = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] periodic_fuzzy_delay           = 60 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] pointer_model                  = ps2mouse {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] preallocate_images             = none {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] publish_errors                 = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] pybasedir                      = /opt/stack/nova {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ram_allocation_ratio           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] rate_limit_burst               = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] rate_limit_except_level        = CRITICAL {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] rate_limit_interval            = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] reboot_timeout                 = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] reclaim_instance_interval      = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] record                         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] reimage_timeout_per_gb         = 20 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] report_interval                = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] rescue_timeout                 = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] reserved_host_cpus             = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] reserved_host_disk_mb          = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] reserved_host_memory_mb        = 512 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] reserved_huge_pages            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] resize_confirm_window          = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] resize_fs_using_block_device   = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] resume_guests_state_on_host_boot = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] rpc_response_timeout           = 60 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] run_external_periodic_tasks    = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] running_deleted_instance_action = reap {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] running_deleted_instance_timeout = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] scheduler_instance_sync_interval = 120 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] service_down_time              = 60 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] servicegroup_driver            = db {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] shelved_offload_time           = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] shelved_poll_interval          = 3600 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] shutdown_timeout               = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] source_is_ipv6                 = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ssl_only                       = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] state_path                     = /opt/stack/data/nova {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] sync_power_state_interval      = 600 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] sync_power_state_pool_size     = 1000 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] syslog_log_facility            = LOG_USER {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] tempdir                        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] timeout_nbd                    = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] transport_url                  = **** {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] update_resources_interval      = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] use_cow_images                 = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] use_eventlog                   = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] use_journal                    = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] use_json                       = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] use_rootwrap_daemon            = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] use_stderr                     = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] use_syslog                     = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vcpu_pin_set                   = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vif_plugging_is_fatal          = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vif_plugging_timeout           = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] virt_mkfs                      = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] volume_usage_poll_interval     = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] watch_log_file                 = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] web                            = /usr/share/spice-html5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_concurrency.disable_process_locking = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.auth_strategy              = keystone {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.compute_link_prefix        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.dhcp_domain                = novalocal {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.enable_instance_password   = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.glance_link_prefix         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.instance_list_per_project_cells = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.list_records_by_skipping_down_cells = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.local_metadata_per_cell    = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.max_limit                  = 1000 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.metadata_cache_expiration  = 15 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.neutron_default_tenant_id  = default {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.use_forwarded_for          = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.use_neutron_default_nets   = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.vendordata_dynamic_targets = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.vendordata_jsonfile_path   = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.backend_argument         = **** {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.config_prefix            = cache.oslo {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.dead_timeout             = 60.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.debug_cache_backend      = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.enable_retry_client      = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.enable_socket_keepalive  = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.enabled                  = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.expiration_time          = 600 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.hashclient_retry_attempts = 2 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.memcache_dead_retry      = 300 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.memcache_password        =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.memcache_sasl_enabled    = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.memcache_username        =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.proxies                  = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.retry_attempts           = 2 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.retry_delay              = 0.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.socket_keepalive_count   = 1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.socket_keepalive_idle    = 1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.socket_keepalive_interval = 1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.tls_allowed_ciphers      = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.tls_cafile               = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.tls_certfile             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.tls_enabled              = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cache.tls_keyfile              = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.auth_section            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.auth_type               = password {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.cafile                  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.certfile                = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.collect_timing          = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.cross_az_attach         = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.debug                   = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.endpoint_template       = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.http_retries            = 3 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.insecure                = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.keyfile                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.os_region_name          = RegionOne {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.split_loggers           = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cinder.timeout                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] compute.cpu_dedicated_set      = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] compute.cpu_shared_set         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] compute.image_type_exclude_list = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] compute.resource_provider_association_refresh = 300 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] compute.shutdown_retry_interval = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] conductor.workers              = 3 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] console.allowed_origins        = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] console.ssl_ciphers            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] console.ssl_minimum_version    = default {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] consoleauth.token_ttl          = 600 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.cafile                  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.certfile                = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.collect_timing          = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.connect_retries         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.connect_retry_delay     = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.endpoint_override       = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.insecure                = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.keyfile                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.max_version             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.min_version             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.region_name             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.service_name            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.service_type            = accelerator {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.split_loggers           = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.status_code_retries     = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.status_code_retry_delay = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.timeout                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] cyborg.version                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.backend               = sqlalchemy {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.connection            = **** {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.connection_debug      = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.connection_parameters =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.connection_recycle_time = 3600 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.connection_trace      = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.db_inc_retry_interval = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.db_max_retries        = 20 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.db_max_retry_interval = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.db_retry_interval     = 1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.max_overflow          = 50 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.max_pool_size         = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.max_retries           = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.mysql_enable_ndb      = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.mysql_wsrep_sync_wait = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.pool_timeout          = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.retry_interval        = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.slave_connection      = **** {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] database.sqlite_synchronous    = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.backend           = sqlalchemy {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.connection        = **** {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.connection_debug  = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.connection_parameters =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.connection_recycle_time = 3600 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.connection_trace  = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.db_inc_retry_interval = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.db_max_retries    = 20 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.db_max_retry_interval = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.db_retry_interval = 1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.max_overflow      = 50 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.max_pool_size     = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.max_retries       = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.mysql_enable_ndb  = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.pool_timeout      = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.retry_interval    = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.slave_connection  = **** {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] api_database.sqlite_synchronous = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] devices.enabled_mdev_types     = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ephemeral_storage_encryption.enabled = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.api_servers             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.cafile                  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.certfile                = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.collect_timing          = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.connect_retries         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.connect_retry_delay     = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.debug                   = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.default_trusted_certificate_ids = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.enable_certificate_validation = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.enable_rbd_download     = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.endpoint_override       = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.insecure                = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.keyfile                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.max_version             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.min_version             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.num_retries             = 3 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.rbd_ceph_conf           =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.rbd_connect_timeout     = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.rbd_pool                =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.rbd_user                =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.region_name             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.service_name            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.service_type            = image {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.split_loggers           = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.status_code_retries     = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.status_code_retry_delay = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.timeout                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.verify_glance_signatures = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] glance.version                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] guestfs.debug                  = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.config_drive_cdrom      = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.config_drive_inject_password = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.enable_remotefx         = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.instances_path_share    =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.limit_cpu_features      = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.use_multipath_io        = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.vswitch_name            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] mks.enabled                    = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] image_cache.manager_interval   = 2400 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] image_cache.precache_concurrency = 1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] image_cache.remove_unused_base_images = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] image_cache.subdirectory_name  = _base {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.api_max_retries         = 60 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.api_retry_interval      = 2 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.auth_section            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.auth_type               = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.cafile                  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.certfile                = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.collect_timing          = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.connect_retries         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.connect_retry_delay     = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.endpoint_override       = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.insecure                = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.keyfile                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.max_version             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.min_version             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.partition_key           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.peer_list               = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.region_name             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.serial_console_state_timeout = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.service_name            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.service_type            = baremetal {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.split_loggers           = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.status_code_retries     = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.status_code_retry_delay = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.timeout                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ironic.version                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] key_manager.fixed_key          = **** {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.barbican_api_version  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.barbican_endpoint     = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.barbican_endpoint_type = public {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.barbican_region_name  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.cafile                = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.certfile              = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.collect_timing        = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.insecure              = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.keyfile               = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.number_of_retries     = 60 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.retry_delay           = 1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.send_service_user_token = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.split_loggers         = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.timeout               = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.verify_ssl            = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican.verify_ssl_path       = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican_service_user.auth_section = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican_service_user.auth_type = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican_service_user.cafile   = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican_service_user.certfile = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican_service_user.collect_timing = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican_service_user.insecure = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican_service_user.keyfile  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican_service_user.split_loggers = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] barbican_service_user.timeout  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.approle_role_id          = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.approle_secret_id        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.cafile                   = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.certfile                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.collect_timing           = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.insecure                 = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.keyfile                  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.kv_mountpoint            = secret {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.kv_version               = 2 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.namespace                = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.root_token_id            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.split_loggers            = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.ssl_ca_crt_file          = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.timeout                  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.use_ssl                  = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.cafile                = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.certfile              = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.collect_timing        = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.connect_retries       = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.connect_retry_delay   = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.endpoint_override     = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.insecure              = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.keyfile               = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.max_version           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.min_version           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.region_name           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.service_name          = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.service_type          = identity {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.split_loggers         = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.status_code_retries   = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.status_code_retry_delay = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.timeout               = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] keystone.version               = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.connection_uri         =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.cpu_mode               = custom {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: WARNING oslo_config.cfg [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.cpu_power_governor_high = performance {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.cpu_power_management   = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.device_detach_attempts = 8 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.device_detach_timeout  = 20 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.disk_cachemodes        = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.disk_prefix            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.enabled_perf_events    = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.file_backed_memory     = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.gid_maps               = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.hw_disk_discard        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.hw_machine_type        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.images_rbd_pool        = rbd {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.images_type            = default {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.images_volume_group    = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.inject_key             = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.inject_partition       = -2 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.inject_password        = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.iscsi_iface            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.iser_use_multipath     = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.live_migration_downtime = 500 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.live_migration_inbound_addr = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.live_migration_scheme  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.live_migration_timeout_action = abort {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.live_migration_tunnelled = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: WARNING oslo_config.cfg [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 11 21:45:43 user nova-compute[71364]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 11 21:45:43 user nova-compute[71364]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 11 21:45:43 user nova-compute[71364]: and ``live_migration_inbound_addr`` respectively.
Apr 11 21:45:43 user nova-compute[71364]: ).  Its value may be silently ignored in the future.
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.live_migration_with_native_tls = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.max_queues             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.nfs_mount_options      = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.num_pcie_ports         = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.pmem_namespaces        = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.quobyte_client_cfg     = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.rbd_secret_uuid        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.rbd_user               = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.rescue_image_id        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.rescue_kernel_id       = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.rx_queue_size          = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.smbfs_mount_options    =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.snapshot_compression   = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.snapshot_image_format  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.sparse_logical_volumes = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.swtpm_enabled          = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.swtpm_group            = tss {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.swtpm_user             = tss {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.sysinfo_serial         = unique {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.tx_queue_size          = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.uid_maps               = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.use_virtio_for_bridges = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.virt_type              = kvm {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.volume_clear           = zero {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.volume_clear_size      = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.volume_use_multipath   = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.vzstorage_cache_path   = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.auth_section           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.auth_type              = password {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.cafile                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.certfile               = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.collect_timing         = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.connect_retries        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.connect_retry_delay    = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.default_floating_pool  = public {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.endpoint_override      = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.extension_sync_interval = 600 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.http_retries           = 3 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.insecure               = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.keyfile                = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.max_version            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.min_version            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.ovs_bridge             = br-int {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.physnets               = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.region_name            = RegionOne {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.service_metadata_proxy = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.service_name           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.service_type           = network {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.split_loggers          = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.status_code_retries    = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.status_code_retry_delay = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.timeout                = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] neutron.version                = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] notifications.bdms_in_notifications = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] notifications.default_level    = INFO {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] notifications.notification_format = unversioned {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] notifications.notify_on_state_change = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] pci.alias                      = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] pci.device_spec                = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] pci.report_in_placement        = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.auth_section         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.auth_type            = password {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.cafile               = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.certfile             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.collect_timing       = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.connect_retries      = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.connect_retry_delay  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.default_domain_id    = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.default_domain_name  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.domain_id            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.domain_name          = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.endpoint_override    = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.insecure             = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.keyfile              = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.max_version          = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.min_version          = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.password             = **** {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.project_domain_id    = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.project_domain_name  = Default {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.project_id           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.project_name         = service {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.region_name          = RegionOne {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.service_name         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.service_type         = placement {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.split_loggers        = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.status_code_retries  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.status_code_retry_delay = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.system_scope         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.timeout              = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.trust_id             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.user_domain_id       = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.user_domain_name     = Default {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.user_id              = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.username             = placement {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] placement.version              = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] quota.cores                    = 20 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] quota.count_usage_from_placement = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] quota.injected_file_content_bytes = 10240 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] quota.injected_file_path_length = 255 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] quota.injected_files           = 5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] quota.instances                = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] quota.key_pairs                = 100 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] quota.metadata_items           = 128 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] quota.ram                      = 51200 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] quota.recheck_quota            = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] quota.server_group_members     = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] quota.server_groups            = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] rdp.enabled                    = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] scheduler.image_metadata_prefilter = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] scheduler.max_attempts         = 3 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] scheduler.max_placement_results = 1000 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] scheduler.workers              = 3 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.host_subset_size = 1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.isolated_hosts = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.isolated_images = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.pci_in_placement = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.track_instance_changes = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] metrics.required               = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] metrics.weight_multiplier      = 1.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] metrics.weight_setting         = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] serial_console.enabled         = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] serial_console.port_range      = 10000:20000 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] serial_console.serialproxy_port = 6083 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] service_user.auth_section      = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] service_user.auth_type         = password {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] service_user.cafile            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] service_user.certfile          = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] service_user.collect_timing    = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] service_user.insecure          = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] service_user.keyfile           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] service_user.send_service_user_token = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] service_user.split_loggers     = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] service_user.timeout           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] spice.agent_enabled            = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] spice.enabled                  = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] spice.html5proxy_port          = 6082 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] spice.image_compression        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] spice.jpeg_compression         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] spice.playback_compression     = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] spice.server_listen            = 127.0.0.1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] spice.streaming_mode           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] spice.zlib_compression         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] upgrade_levels.baseapi         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] upgrade_levels.cert            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] upgrade_levels.compute         = auto {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] upgrade_levels.conductor       = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] upgrade_levels.scheduler       = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vendordata_dynamic_auth.cafile = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vendordata_dynamic_auth.certfile = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vendordata_dynamic_auth.insecure = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vendordata_dynamic_auth.timeout = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.api_retry_count         = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.ca_file                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.cache_prefix            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.cluster_name            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.connection_pool_size    = 10 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.console_delay_seconds   = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.datastore_regex         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.host_ip                 = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.host_password           = **** {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.host_port               = 443 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.host_username           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.insecure                = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.integration_bridge      = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.maximum_objects         = 100 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.pbm_default_policy      = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.pbm_enabled             = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.pbm_wsdl_location       = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.serial_port_proxy_uri   = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.serial_port_service_uri = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.task_poll_interval      = 0.5 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.use_linked_clone        = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.vnc_keymap              = en-us {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.vnc_port                = 5900 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vmware.vnc_port_total          = 10000 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vnc.auth_schemes               = ['none'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vnc.enabled                    = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vnc.novncproxy_port            = 6080 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vnc.vencrypt_ca_certs          = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vnc.vencrypt_client_cert       = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vnc.vencrypt_client_key        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.disable_rootwrap   = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.enable_numa_live_migration = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.libvirt_disable_apic = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] wsgi.client_socket_timeout     = 900 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] wsgi.default_pool_size         = 1000 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] wsgi.keep_alive                = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] wsgi.max_header_line           = 16384 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] wsgi.ssl_ca_file               = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] wsgi.ssl_cert_file             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] wsgi.ssl_key_file              = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] wsgi.tcp_keepidle              = 600 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] zvm.ca_file                    = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] zvm.cloud_connector_url        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] zvm.reachable_timeout          = 300 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_policy.enforce_new_defaults = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_policy.enforce_scope      = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_policy.policy_default_rule = default {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] profiler.connection_string     = messaging:// {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] profiler.enabled               = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] profiler.es_doc_type           = notification {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] profiler.es_scroll_size        = 10000 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] profiler.es_scroll_time        = 2m {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] profiler.filter_error_trace    = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] profiler.sentinel_service_name = mymaster {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] profiler.socket_timeout        = 0.1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] profiler.trace_sqlalchemy      = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] remote_debug.host              = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] remote_debug.port              = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_notifications.retry = -1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.auth_section        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.auth_type           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.cafile              = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.certfile            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.collect_timing      = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.connect_retries     = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.connect_retry_delay = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.endpoint_id         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.endpoint_override   = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.insecure            = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.keyfile             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.max_version         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.min_version         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.region_name         = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.service_name        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.service_type        = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.split_loggers       = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.status_code_retries = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.status_code_retry_delay = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.timeout             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.valid_interfaces    = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_limit.version             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_reports.file_event_handler = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] oslo_reports.log_dir           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vif_plug_ovs_privileged.group  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] vif_plug_ovs_privileged.user   = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_vif_ovs.isolate_vif         = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] os_brick.lock_path             = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] privsep_osbrick.capabilities   = [21] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] privsep_osbrick.group          = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] privsep_osbrick.helper_command = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] privsep_osbrick.user           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] nova_sys_admin.group           = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] nova_sys_admin.helper_command  = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] nova_sys_admin.user            = None {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG oslo_service.service [None req-2567eeac-9c3f-40e0-9561-4529e2b68bd0 None None] ******************************************************************************** {{(pid=71364) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 11 21:45:43 user nova-compute[71364]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 11 21:45:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Starting native event thread {{(pid=71364) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Starting green dispatch thread {{(pid=71364) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Starting connection event dispatch thread {{(pid=71364) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Connecting to libvirt: qemu:///system {{(pid=71364) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4bf7fbe620> {{(pid=71364) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 11 21:45:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4bf7fbe620> {{(pid=71364) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 11 21:45:43 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Connection event '1' reason 'None'
Apr 11 21:45:43 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 11 21:45:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.mount [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Initialising _HostMountState generation 0 {{(pid=71364) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 11 21:45:50 user nova-compute[71364]: INFO nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Libvirt host capabilities <capabilities>
Apr 11 21:45:50 user nova-compute[71364]:   <host>
Apr 11 21:45:50 user nova-compute[71364]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 11 21:45:50 user nova-compute[71364]:     <cpu>
Apr 11 21:45:50 user nova-compute[71364]:       <arch>x86_64</arch>
Apr 11 21:45:50 user nova-compute[71364]:       <model>IvyBridge-IBRS</model>
Apr 11 21:45:50 user nova-compute[71364]:       <vendor>Intel</vendor>
Apr 11 21:45:50 user nova-compute[71364]:       <microcode version='1070'/>
Apr 11 21:45:50 user nova-compute[71364]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 11 21:45:50 user nova-compute[71364]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 11 21:45:50 user nova-compute[71364]:       <feature name='ss'/>
Apr 11 21:45:50 user nova-compute[71364]:       <feature name='vmx'/>
Apr 11 21:45:50 user nova-compute[71364]:       <feature name='pcid'/>
Apr 11 21:45:50 user nova-compute[71364]:       <feature name='osxsave'/>
Apr 11 21:45:50 user nova-compute[71364]:       <feature name='hypervisor'/>
Apr 11 21:45:50 user nova-compute[71364]:       <feature name='arat'/>
Apr 11 21:45:50 user nova-compute[71364]:       <feature name='tsc_adjust'/>
Apr 11 21:45:50 user nova-compute[71364]:       <feature name='md-clear'/>
Apr 11 21:45:50 user nova-compute[71364]:       <feature name='stibp'/>
Apr 11 21:45:50 user nova-compute[71364]:       <feature name='arch-capabilities'/>
Apr 11 21:45:50 user nova-compute[71364]:       <feature name='ssbd'/>
Apr 11 21:45:50 user nova-compute[71364]:       <feature name='invtsc'/>
Apr 11 21:45:50 user nova-compute[71364]:       <feature name='rsba'/>
Apr 11 21:45:50 user nova-compute[71364]:       <feature name='skip-l1dfl-vmentry'/>
Apr 11 21:45:50 user nova-compute[71364]:       <pages unit='KiB' size='4'/>
Apr 11 21:45:50 user nova-compute[71364]:       <pages unit='KiB' size='2048'/>
Apr 11 21:45:50 user nova-compute[71364]:     </cpu>
Apr 11 21:45:50 user nova-compute[71364]:     <power_management>
Apr 11 21:45:50 user nova-compute[71364]:       <suspend_mem/>
Apr 11 21:45:50 user nova-compute[71364]:       <suspend_disk/>
Apr 11 21:45:50 user nova-compute[71364]:       <suspend_hybrid/>
Apr 11 21:45:50 user nova-compute[71364]:     </power_management>
Apr 11 21:45:50 user nova-compute[71364]:     <iommu support='no'/>
Apr 11 21:45:50 user nova-compute[71364]:     <migration_features>
Apr 11 21:45:50 user nova-compute[71364]:       <live/>
Apr 11 21:45:50 user nova-compute[71364]:       <uri_transports>
Apr 11 21:45:50 user nova-compute[71364]:         <uri_transport>tcp</uri_transport>
Apr 11 21:45:50 user nova-compute[71364]:         <uri_transport>rdma</uri_transport>
Apr 11 21:45:50 user nova-compute[71364]:       </uri_transports>
Apr 11 21:45:50 user nova-compute[71364]:     </migration_features>
Apr 11 21:45:50 user nova-compute[71364]:     <topology>
Apr 11 21:45:50 user nova-compute[71364]:       <cells num='2'>
Apr 11 21:45:50 user nova-compute[71364]:         <cell id='0'>
Apr 11 21:45:50 user nova-compute[71364]:           <memory unit='KiB'>8189224</memory>
Apr 11 21:45:50 user nova-compute[71364]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 11 21:45:50 user nova-compute[71364]:           <pages unit='KiB' size='2048'>0</pages>
Apr 11 21:45:50 user nova-compute[71364]:           <distances>
Apr 11 21:45:50 user nova-compute[71364]:             <sibling id='0' value='10'/>
Apr 11 21:45:50 user nova-compute[71364]:             <sibling id='1' value='20'/>
Apr 11 21:45:50 user nova-compute[71364]:           </distances>
Apr 11 21:45:50 user nova-compute[71364]:           <cpus num='6'>
Apr 11 21:45:50 user nova-compute[71364]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 11 21:45:50 user nova-compute[71364]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 11 21:45:50 user nova-compute[71364]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 11 21:45:50 user nova-compute[71364]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 11 21:45:50 user nova-compute[71364]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 11 21:45:50 user nova-compute[71364]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 11 21:45:50 user nova-compute[71364]:           </cpus>
Apr 11 21:45:50 user nova-compute[71364]:         </cell>
Apr 11 21:45:50 user nova-compute[71364]:         <cell id='1'>
Apr 11 21:45:50 user nova-compute[71364]:           <memory unit='KiB'>8218764</memory>
Apr 11 21:45:50 user nova-compute[71364]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 11 21:45:50 user nova-compute[71364]:           <pages unit='KiB' size='2048'>0</pages>
Apr 11 21:45:50 user nova-compute[71364]:           <distances>
Apr 11 21:45:50 user nova-compute[71364]:             <sibling id='0' value='20'/>
Apr 11 21:45:50 user nova-compute[71364]:             <sibling id='1' value='10'/>
Apr 11 21:45:50 user nova-compute[71364]:           </distances>
Apr 11 21:45:50 user nova-compute[71364]:           <cpus num='6'>
Apr 11 21:45:50 user nova-compute[71364]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 11 21:45:50 user nova-compute[71364]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 11 21:45:50 user nova-compute[71364]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 11 21:45:50 user nova-compute[71364]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 11 21:45:50 user nova-compute[71364]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 11 21:45:50 user nova-compute[71364]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 11 21:45:50 user nova-compute[71364]:           </cpus>
Apr 11 21:45:50 user nova-compute[71364]:         </cell>
Apr 11 21:45:50 user nova-compute[71364]:       </cells>
Apr 11 21:45:50 user nova-compute[71364]:     </topology>
Apr 11 21:45:50 user nova-compute[71364]:     <cache>
Apr 11 21:45:50 user nova-compute[71364]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 11 21:45:50 user nova-compute[71364]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 11 21:45:50 user nova-compute[71364]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 11 21:45:50 user nova-compute[71364]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 11 21:45:50 user nova-compute[71364]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 11 21:45:50 user nova-compute[71364]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 11 21:45:50 user nova-compute[71364]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 11 21:45:50 user nova-compute[71364]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 11 21:45:50 user nova-compute[71364]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 11 21:45:50 user nova-compute[71364]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 11 21:45:50 user nova-compute[71364]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 11 21:45:50 user nova-compute[71364]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 11 21:45:50 user nova-compute[71364]:     </cache>
Apr 11 21:45:50 user nova-compute[71364]:     <secmodel>
Apr 11 21:45:50 user nova-compute[71364]:       <model>apparmor</model>
Apr 11 21:45:50 user nova-compute[71364]:       <doi>0</doi>
Apr 11 21:45:50 user nova-compute[71364]:     </secmodel>
Apr 11 21:45:50 user nova-compute[71364]:     <secmodel>
Apr 11 21:45:50 user nova-compute[71364]:       <model>dac</model>
Apr 11 21:45:50 user nova-compute[71364]:       <doi>0</doi>
Apr 11 21:45:50 user nova-compute[71364]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 11 21:45:50 user nova-compute[71364]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 11 21:45:50 user nova-compute[71364]:     </secmodel>
Apr 11 21:45:50 user nova-compute[71364]:   </host>
Apr 11 21:45:50 user nova-compute[71364]:   <guest>
Apr 11 21:45:50 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:50 user nova-compute[71364]:     <arch name='alpha'>
Apr 11 21:45:50 user nova-compute[71364]:       <wordsize>64</wordsize>
Apr 11 21:45:50 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='4'>clipper</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:50 user nova-compute[71364]:     </arch>
Apr 11 21:45:50 user nova-compute[71364]:     <features>
Apr 11 21:45:50 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:50 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:50 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:50 user nova-compute[71364]:     </features>
Apr 11 21:45:50 user nova-compute[71364]:   </guest>
Apr 11 21:45:50 user nova-compute[71364]:   <guest>
Apr 11 21:45:50 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:50 user nova-compute[71364]:     <arch name='armv6l'>
Apr 11 21:45:50 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:50 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>spitz</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>nuri</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>kzm</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>sx1</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>z2</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>tosa</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>n810</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>n800</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>terrier</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='4'>midway</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>microbit</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>verdex</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='4'>highbank</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>akita</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>connex</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>collie</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:50 user nova-compute[71364]:     </arch>
Apr 11 21:45:50 user nova-compute[71364]:     <features>
Apr 11 21:45:50 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:50 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:50 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:50 user nova-compute[71364]:     </features>
Apr 11 21:45:50 user nova-compute[71364]:   </guest>
Apr 11 21:45:50 user nova-compute[71364]:   <guest>
Apr 11 21:45:50 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:50 user nova-compute[71364]:     <arch name='armv7l'>
Apr 11 21:45:50 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:50 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>spitz</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>nuri</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 21:45:50 user nova-compute[71364]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>kzm</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>sx1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>z2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>tosa</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>n810</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>n800</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>terrier</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>midway</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>microbit</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>verdex</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>highbank</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>akita</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>connex</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>collie</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='aarch64'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>64</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>integratorcp</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>borzoi</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>spitz</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>nuri</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>musca-b1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>versatileab</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>kzm</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>musca-a</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>smdkc210</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>sx1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>z2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>tosa</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>sabrelite</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>realview-eb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>n810</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>n800</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>versatilepb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>terrier</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mainstone</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>midway</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>musicpal</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>microbit</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>cubieboard</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>verdex</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>netduino2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>raspi3b</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>raspi2b</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>cheetah</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>highbank</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>akita</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>connex</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>collie</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>raspi0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <acpi default='on' toggle='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='cris'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='i686'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>x-remote</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>isapc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>microvm</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='kvm'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <pae/>
Apr 11 21:45:51 user nova-compute[71364]:       <nonpae/>
Apr 11 21:45:51 user nova-compute[71364]:       <acpi default='on' toggle='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:       <apic default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='m68k'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>an5206</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>q800</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>next-cube</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='microblaze'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='microblazeel'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='mips'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='16'>malta</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='mipsel'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='16'>malta</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='mips64'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>64</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='16'>malta</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>pica61</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>magnum</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='mips64el'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>64</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='16'>malta</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mipssim</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>pica61</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>magnum</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='16'>boston</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='ppc'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mac99</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>40p</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>taihu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='ppc64'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>64</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2048'>powernv9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>taihu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2048'>powernv10</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>40p</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mac99</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2048'>powernv8</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='ppc64le'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>64</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2048'>powernv9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>taihu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2048'>powernv10</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>ppce500</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>40p</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>pegasos2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>bamboo</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>g3beige</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>mac99</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>sam460ex</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>ref405ep</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2048'>powernv8</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='riscv32'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='8'>spike</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>opentitan</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='5'>sifive_u</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>sifive_e</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='8'>virt</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='riscv64'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>64</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='8'>spike</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='5'>sifive_u</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>shakti_c</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>sifive_e</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='8'>virt</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='s390x'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>64</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='sh4'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>shix</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>r2d</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='sh4eb'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>64</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>shix</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>r2d</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='sparc'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>SS-5</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>SS-20</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>LX</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>SS-4</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>SS-10</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>Voyager</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='sparc64'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>64</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>sun4u</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>niagara</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>sun4v</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='x86_64'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>64</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>x-remote</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='1'>isapc</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>microvm</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='kvm'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <acpi default='on' toggle='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:       <apic default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='xtensa'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>sim</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>kc705</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>ml605</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>virt</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>lx200</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>lx60</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]:   <guest>
Apr 11 21:45:51 user nova-compute[71364]:     <os_type>hvm</os_type>
Apr 11 21:45:51 user nova-compute[71364]:     <arch name='xtensaeb'>
Apr 11 21:45:51 user nova-compute[71364]:       <wordsize>32</wordsize>
Apr 11 21:45:51 user nova-compute[71364]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='4'>sim</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>kc705</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>ml605</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>virt</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>lx200</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>lx60</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 11 21:45:51 user nova-compute[71364]:       <domain type='qemu'/>
Apr 11 21:45:51 user nova-compute[71364]:     </arch>
Apr 11 21:45:51 user nova-compute[71364]:     <features>
Apr 11 21:45:51 user nova-compute[71364]:       <cpuselection/>
Apr 11 21:45:51 user nova-compute[71364]:       <deviceboot/>
Apr 11 21:45:51 user nova-compute[71364]:       <disksnapshot default='on' toggle='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     </features>
Apr 11 21:45:51 user nova-compute[71364]:   </guest>
Apr 11 21:45:51 user nova-compute[71364]: </capabilities>
Apr 11 21:45:51 user nova-compute[71364]: 
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 11 21:45:51 user nova-compute[71364]: <domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 21:45:51 user nova-compute[71364]:   <domain>kvm</domain>
Apr 11 21:45:51 user nova-compute[71364]:   <machine>pc-q35-6.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:   <arch>i686</arch>
Apr 11 21:45:51 user nova-compute[71364]:   <vcpu max='288'/>
Apr 11 21:45:51 user nova-compute[71364]:   <iothreads supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:   <os supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='firmware'/>
Apr 11 21:45:51 user nova-compute[71364]:     <loader supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>rom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pflash</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='readonly'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>yes</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='secure'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </loader>
Apr 11 21:45:51 user nova-compute[71364]:   </os>
Apr 11 21:45:51 user nova-compute[71364]:   <cpu>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-passthrough' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='hostPassthroughMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='maximum' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='maximumMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>on</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-model' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <vendor>Intel</vendor>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ss'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='vmx'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='pcid'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='hypervisor'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arat'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='umip'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='md-clear'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibpb'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibrs'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='erms'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='lm'/>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='custom' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>qemu64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>qemu32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>phenom</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>n270</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>kvm64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>kvm32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>coreduo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>core2duo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>athlon</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Westmere</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Snowridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Penryn</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G5</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G4</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G1</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Nehalem</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Rome</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Milan</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Dhyana</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cooperlake</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Conroe</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>486</model>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:   </cpu>
Apr 11 21:45:51 user nova-compute[71364]:   <memoryBacking supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='sourceType'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>file</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>anonymous</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>memfd</value>
Apr 11 21:45:51 user nova-compute[71364]:     </enum>
Apr 11 21:45:51 user nova-compute[71364]:   </memoryBacking>
Apr 11 21:45:51 user nova-compute[71364]:   <devices>
Apr 11 21:45:51 user nova-compute[71364]:     <disk supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='diskDevice'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>disk</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cdrom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>floppy</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>lun</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='bus'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>fdc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sata</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </disk>
Apr 11 21:45:51 user nova-compute[71364]:     <graphics supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sdl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vnc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>spice</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egl-headless</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </graphics>
Apr 11 21:45:51 user nova-compute[71364]:     <video supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='modelType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cirrus</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vmvga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>qxl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>none</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>bochs</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>ramfb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </video>
Apr 11 21:45:51 user nova-compute[71364]:     <hostdev supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='mode'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>subsystem</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='startupPolicy'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>default</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>mandatory</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>requisite</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>optional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='subsysType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pci</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='capsType'/>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='pciBackend'/>
Apr 11 21:45:51 user nova-compute[71364]:     </hostdev>
Apr 11 21:45:51 user nova-compute[71364]:     <rng supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>random</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egd</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>builtin</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </rng>
Apr 11 21:45:51 user nova-compute[71364]:     <filesystem supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='driverType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>path</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>handle</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtiofs</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </filesystem>
Apr 11 21:45:51 user nova-compute[71364]:     <tpm supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-tis</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-crb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>passthrough</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>emulator</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </tpm>
Apr 11 21:45:51 user nova-compute[71364]:   </devices>
Apr 11 21:45:51 user nova-compute[71364]:   <features>
Apr 11 21:45:51 user nova-compute[71364]:     <gic supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     <vmcoreinfo supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <genid supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backingStoreInput supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backup supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <sev supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:   </features>
Apr 11 21:45:51 user nova-compute[71364]: </domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:  {{(pid=71364) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 11 21:45:51 user nova-compute[71364]: <domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 21:45:51 user nova-compute[71364]:   <domain>kvm</domain>
Apr 11 21:45:51 user nova-compute[71364]:   <machine>pc-i440fx-jammy</machine>
Apr 11 21:45:51 user nova-compute[71364]:   <arch>i686</arch>
Apr 11 21:45:51 user nova-compute[71364]:   <vcpu max='255'/>
Apr 11 21:45:51 user nova-compute[71364]:   <iothreads supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:   <os supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='firmware'/>
Apr 11 21:45:51 user nova-compute[71364]:     <loader supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>rom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pflash</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='readonly'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>yes</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='secure'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </loader>
Apr 11 21:45:51 user nova-compute[71364]:   </os>
Apr 11 21:45:51 user nova-compute[71364]:   <cpu>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-passthrough' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='hostPassthroughMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='maximum' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='maximumMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>on</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-model' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <vendor>Intel</vendor>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ss'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='vmx'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='pcid'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='hypervisor'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arat'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='umip'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='md-clear'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibpb'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibrs'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='erms'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='lm'/>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='custom' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>qemu64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>qemu32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>phenom</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>n270</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>kvm64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>kvm32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>coreduo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>core2duo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>athlon</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Westmere</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Snowridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Penryn</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G5</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G4</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G1</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Nehalem</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Rome</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Milan</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Dhyana</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cooperlake</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Conroe</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>486</model>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:   </cpu>
Apr 11 21:45:51 user nova-compute[71364]:   <memoryBacking supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='sourceType'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>file</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>anonymous</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>memfd</value>
Apr 11 21:45:51 user nova-compute[71364]:     </enum>
Apr 11 21:45:51 user nova-compute[71364]:   </memoryBacking>
Apr 11 21:45:51 user nova-compute[71364]:   <devices>
Apr 11 21:45:51 user nova-compute[71364]:     <disk supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='diskDevice'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>disk</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cdrom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>floppy</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>lun</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='bus'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>ide</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>fdc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sata</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </disk>
Apr 11 21:45:51 user nova-compute[71364]:     <graphics supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sdl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vnc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>spice</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egl-headless</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </graphics>
Apr 11 21:45:51 user nova-compute[71364]:     <video supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='modelType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cirrus</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vmvga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>qxl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>none</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>bochs</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>ramfb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </video>
Apr 11 21:45:51 user nova-compute[71364]:     <hostdev supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='mode'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>subsystem</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='startupPolicy'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>default</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>mandatory</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>requisite</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>optional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='subsysType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pci</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='capsType'/>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='pciBackend'/>
Apr 11 21:45:51 user nova-compute[71364]:     </hostdev>
Apr 11 21:45:51 user nova-compute[71364]:     <rng supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>random</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egd</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>builtin</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </rng>
Apr 11 21:45:51 user nova-compute[71364]:     <filesystem supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='driverType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>path</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>handle</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtiofs</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </filesystem>
Apr 11 21:45:51 user nova-compute[71364]:     <tpm supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-tis</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-crb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>passthrough</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>emulator</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </tpm>
Apr 11 21:45:51 user nova-compute[71364]:   </devices>
Apr 11 21:45:51 user nova-compute[71364]:   <features>
Apr 11 21:45:51 user nova-compute[71364]:     <gic supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     <vmcoreinfo supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <genid supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backingStoreInput supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backup supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <sev supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:   </features>
Apr 11 21:45:51 user nova-compute[71364]: </domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:  {{(pid=71364) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 11 21:45:51 user nova-compute[71364]: <domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 21:45:51 user nova-compute[71364]:   <domain>kvm</domain>
Apr 11 21:45:51 user nova-compute[71364]:   <machine>pc-i440fx-6.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:   <arch>i686</arch>
Apr 11 21:45:51 user nova-compute[71364]:   <vcpu max='255'/>
Apr 11 21:45:51 user nova-compute[71364]:   <iothreads supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:   <os supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='firmware'/>
Apr 11 21:45:51 user nova-compute[71364]:     <loader supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>rom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pflash</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='readonly'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>yes</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='secure'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </loader>
Apr 11 21:45:51 user nova-compute[71364]:   </os>
Apr 11 21:45:51 user nova-compute[71364]:   <cpu>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-passthrough' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='hostPassthroughMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='maximum' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='maximumMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>on</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-model' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <vendor>Intel</vendor>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ss'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='vmx'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='pcid'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='hypervisor'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arat'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='umip'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='md-clear'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibpb'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibrs'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='erms'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='lm'/>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='custom' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>qemu64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>qemu32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>phenom</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>n270</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>kvm64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>kvm32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>coreduo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>core2duo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>athlon</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Westmere</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Snowridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Penryn</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G5</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G4</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G1</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Nehalem</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Rome</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Milan</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Dhyana</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cooperlake</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Conroe</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>486</model>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:   </cpu>
Apr 11 21:45:51 user nova-compute[71364]:   <memoryBacking supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='sourceType'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>file</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>anonymous</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>memfd</value>
Apr 11 21:45:51 user nova-compute[71364]:     </enum>
Apr 11 21:45:51 user nova-compute[71364]:   </memoryBacking>
Apr 11 21:45:51 user nova-compute[71364]:   <devices>
Apr 11 21:45:51 user nova-compute[71364]:     <disk supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='diskDevice'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>disk</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cdrom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>floppy</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>lun</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='bus'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>ide</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>fdc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sata</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </disk>
Apr 11 21:45:51 user nova-compute[71364]:     <graphics supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sdl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vnc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>spice</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egl-headless</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </graphics>
Apr 11 21:45:51 user nova-compute[71364]:     <video supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='modelType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cirrus</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vmvga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>qxl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>none</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>bochs</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>ramfb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </video>
Apr 11 21:45:51 user nova-compute[71364]:     <hostdev supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='mode'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>subsystem</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='startupPolicy'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>default</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>mandatory</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>requisite</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>optional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='subsysType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pci</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='capsType'/>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='pciBackend'/>
Apr 11 21:45:51 user nova-compute[71364]:     </hostdev>
Apr 11 21:45:51 user nova-compute[71364]:     <rng supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>random</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egd</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>builtin</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </rng>
Apr 11 21:45:51 user nova-compute[71364]:     <filesystem supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='driverType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>path</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>handle</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtiofs</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </filesystem>
Apr 11 21:45:51 user nova-compute[71364]:     <tpm supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-tis</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-crb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>passthrough</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>emulator</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </tpm>
Apr 11 21:45:51 user nova-compute[71364]:   </devices>
Apr 11 21:45:51 user nova-compute[71364]:   <features>
Apr 11 21:45:51 user nova-compute[71364]:     <gic supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     <vmcoreinfo supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <genid supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backingStoreInput supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backup supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <sev supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:   </features>
Apr 11 21:45:51 user nova-compute[71364]: </domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:  {{(pid=71364) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 11 21:45:51 user nova-compute[71364]: <domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:   <path>/usr/bin/qemu-system-i386</path>
Apr 11 21:45:51 user nova-compute[71364]:   <domain>kvm</domain>
Apr 11 21:45:51 user nova-compute[71364]:   <machine>pc-q35-jammy</machine>
Apr 11 21:45:51 user nova-compute[71364]:   <arch>i686</arch>
Apr 11 21:45:51 user nova-compute[71364]:   <vcpu max='288'/>
Apr 11 21:45:51 user nova-compute[71364]:   <iothreads supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:   <os supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='firmware'/>
Apr 11 21:45:51 user nova-compute[71364]:     <loader supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>rom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pflash</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='readonly'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>yes</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='secure'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </loader>
Apr 11 21:45:51 user nova-compute[71364]:   </os>
Apr 11 21:45:51 user nova-compute[71364]:   <cpu>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-passthrough' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='hostPassthroughMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='maximum' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='maximumMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>on</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-model' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <vendor>Intel</vendor>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ss'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='vmx'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='pcid'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='hypervisor'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arat'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='umip'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='md-clear'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibpb'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibrs'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='erms'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='lm'/>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='custom' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>qemu64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>qemu32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>phenom</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>n270</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>kvm64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>kvm32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>coreduo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>core2duo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>athlon</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Westmere-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Westmere</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Snowridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Penryn</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G5</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G4</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G1</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Nehalem-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Nehalem</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Rome</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Milan</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Dhyana</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cooperlake</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Conroe</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>486</model>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:   </cpu>
Apr 11 21:45:51 user nova-compute[71364]:   <memoryBacking supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='sourceType'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>file</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>anonymous</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>memfd</value>
Apr 11 21:45:51 user nova-compute[71364]:     </enum>
Apr 11 21:45:51 user nova-compute[71364]:   </memoryBacking>
Apr 11 21:45:51 user nova-compute[71364]:   <devices>
Apr 11 21:45:51 user nova-compute[71364]:     <disk supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='diskDevice'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>disk</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cdrom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>floppy</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>lun</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='bus'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>fdc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sata</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </disk>
Apr 11 21:45:51 user nova-compute[71364]:     <graphics supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sdl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vnc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>spice</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egl-headless</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </graphics>
Apr 11 21:45:51 user nova-compute[71364]:     <video supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='modelType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cirrus</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vmvga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>qxl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>none</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>bochs</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>ramfb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </video>
Apr 11 21:45:51 user nova-compute[71364]:     <hostdev supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='mode'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>subsystem</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='startupPolicy'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>default</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>mandatory</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>requisite</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>optional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='subsysType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pci</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='capsType'/>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='pciBackend'/>
Apr 11 21:45:51 user nova-compute[71364]:     </hostdev>
Apr 11 21:45:51 user nova-compute[71364]:     <rng supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>random</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egd</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>builtin</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </rng>
Apr 11 21:45:51 user nova-compute[71364]:     <filesystem supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='driverType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>path</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>handle</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtiofs</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </filesystem>
Apr 11 21:45:51 user nova-compute[71364]:     <tpm supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-tis</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-crb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>passthrough</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>emulator</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </tpm>
Apr 11 21:45:51 user nova-compute[71364]:   </devices>
Apr 11 21:45:51 user nova-compute[71364]:   <features>
Apr 11 21:45:51 user nova-compute[71364]:     <gic supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     <vmcoreinfo supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <genid supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backingStoreInput supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backup supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <sev supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:   </features>
Apr 11 21:45:51 user nova-compute[71364]: </domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:  {{(pid=71364) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 11 21:45:51 user nova-compute[71364]: <domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 21:45:51 user nova-compute[71364]:   <domain>kvm</domain>
Apr 11 21:45:51 user nova-compute[71364]:   <machine>pc-q35-6.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:   <arch>x86_64</arch>
Apr 11 21:45:51 user nova-compute[71364]:   <vcpu max='288'/>
Apr 11 21:45:51 user nova-compute[71364]:   <iothreads supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:   <os supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='firmware'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>efi</value>
Apr 11 21:45:51 user nova-compute[71364]:     </enum>
Apr 11 21:45:51 user nova-compute[71364]:     <loader supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>rom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pflash</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='readonly'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>yes</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='secure'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>yes</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </loader>
Apr 11 21:45:51 user nova-compute[71364]:   </os>
Apr 11 21:45:51 user nova-compute[71364]:   <cpu>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-passthrough' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='hostPassthroughMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>on</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='maximum' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='maximumMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>on</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-model' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <vendor>Intel</vendor>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ss'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='vmx'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='pcid'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='hypervisor'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arat'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='umip'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='md-clear'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='invtsc'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibpb'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibrs'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='rsba'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='erms'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='custom' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>qemu64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>qemu32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>phenom</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>n270</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>kvm64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>kvm32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>coreduo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>core2duo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>athlon</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Westmere</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Snowridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Penryn</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G5</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G4</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Opteron_G1</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Nehalem</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Rome</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Milan</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Dhyana</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cooperlake</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Conroe</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>486</model>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:   </cpu>
Apr 11 21:45:51 user nova-compute[71364]:   <memoryBacking supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='sourceType'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>file</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>anonymous</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>memfd</value>
Apr 11 21:45:51 user nova-compute[71364]:     </enum>
Apr 11 21:45:51 user nova-compute[71364]:   </memoryBacking>
Apr 11 21:45:51 user nova-compute[71364]:   <devices>
Apr 11 21:45:51 user nova-compute[71364]:     <disk supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='diskDevice'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>disk</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cdrom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>floppy</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>lun</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='bus'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>fdc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sata</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </disk>
Apr 11 21:45:51 user nova-compute[71364]:     <graphics supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sdl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vnc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>spice</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egl-headless</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </graphics>
Apr 11 21:45:51 user nova-compute[71364]:     <video supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='modelType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cirrus</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vmvga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>qxl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>none</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>bochs</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>ramfb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </video>
Apr 11 21:45:51 user nova-compute[71364]:     <hostdev supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='mode'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>subsystem</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='startupPolicy'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>default</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>mandatory</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>requisite</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>optional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='subsysType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pci</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='capsType'/>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='pciBackend'/>
Apr 11 21:45:51 user nova-compute[71364]:     </hostdev>
Apr 11 21:45:51 user nova-compute[71364]:     <rng supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>random</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egd</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>builtin</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </rng>
Apr 11 21:45:51 user nova-compute[71364]:     <filesystem supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='driverType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>path</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>handle</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtiofs</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </filesystem>
Apr 11 21:45:51 user nova-compute[71364]:     <tpm supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-tis</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-crb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>passthrough</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>emulator</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </tpm>
Apr 11 21:45:51 user nova-compute[71364]:   </devices>
Apr 11 21:45:51 user nova-compute[71364]:   <features>
Apr 11 21:45:51 user nova-compute[71364]:     <gic supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     <vmcoreinfo supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <genid supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backingStoreInput supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backup supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <sev supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:   </features>
Apr 11 21:45:51 user nova-compute[71364]: </domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:  {{(pid=71364) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 11 21:45:51 user nova-compute[71364]: <domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 21:45:51 user nova-compute[71364]:   <domain>kvm</domain>
Apr 11 21:45:51 user nova-compute[71364]:   <machine>pc-i440fx-jammy</machine>
Apr 11 21:45:51 user nova-compute[71364]:   <arch>x86_64</arch>
Apr 11 21:45:51 user nova-compute[71364]:   <vcpu max='255'/>
Apr 11 21:45:51 user nova-compute[71364]:   <iothreads supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:   <os supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='firmware'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>efi</value>
Apr 11 21:45:51 user nova-compute[71364]:     </enum>
Apr 11 21:45:51 user nova-compute[71364]:     <loader supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>rom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pflash</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='readonly'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>yes</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='secure'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </loader>
Apr 11 21:45:51 user nova-compute[71364]:   </os>
Apr 11 21:45:51 user nova-compute[71364]:   <cpu>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-passthrough' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='hostPassthroughMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>on</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='maximum' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='maximumMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>on</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-model' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <vendor>Intel</vendor>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ss'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='vmx'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='pcid'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='hypervisor'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arat'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='umip'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='md-clear'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='invtsc'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibpb'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibrs'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='rsba'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='erms'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='custom' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>qemu64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>qemu32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>phenom</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>n270</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>kvm64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>kvm32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>coreduo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>core2duo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>athlon</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Westmere</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Snowridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Penryn</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G5</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G4</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Opteron_G1</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Nehalem</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Rome</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Milan</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Dhyana</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cooperlake</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Conroe</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>486</model>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:   </cpu>
Apr 11 21:45:51 user nova-compute[71364]:   <memoryBacking supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='sourceType'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>file</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>anonymous</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>memfd</value>
Apr 11 21:45:51 user nova-compute[71364]:     </enum>
Apr 11 21:45:51 user nova-compute[71364]:   </memoryBacking>
Apr 11 21:45:51 user nova-compute[71364]:   <devices>
Apr 11 21:45:51 user nova-compute[71364]:     <disk supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='diskDevice'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>disk</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cdrom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>floppy</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>lun</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='bus'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>ide</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>fdc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sata</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </disk>
Apr 11 21:45:51 user nova-compute[71364]:     <graphics supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sdl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vnc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>spice</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egl-headless</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </graphics>
Apr 11 21:45:51 user nova-compute[71364]:     <video supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='modelType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cirrus</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vmvga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>qxl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>none</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>bochs</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>ramfb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </video>
Apr 11 21:45:51 user nova-compute[71364]:     <hostdev supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='mode'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>subsystem</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='startupPolicy'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>default</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>mandatory</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>requisite</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>optional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='subsysType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pci</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='capsType'/>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='pciBackend'/>
Apr 11 21:45:51 user nova-compute[71364]:     </hostdev>
Apr 11 21:45:51 user nova-compute[71364]:     <rng supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>random</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egd</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>builtin</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </rng>
Apr 11 21:45:51 user nova-compute[71364]:     <filesystem supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='driverType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>path</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>handle</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtiofs</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </filesystem>
Apr 11 21:45:51 user nova-compute[71364]:     <tpm supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-tis</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-crb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>passthrough</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>emulator</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </tpm>
Apr 11 21:45:51 user nova-compute[71364]:   </devices>
Apr 11 21:45:51 user nova-compute[71364]:   <features>
Apr 11 21:45:51 user nova-compute[71364]:     <gic supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     <vmcoreinfo supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <genid supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backingStoreInput supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backup supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <sev supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:   </features>
Apr 11 21:45:51 user nova-compute[71364]: </domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:  {{(pid=71364) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 11 21:45:51 user nova-compute[71364]: <domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 21:45:51 user nova-compute[71364]:   <domain>kvm</domain>
Apr 11 21:45:51 user nova-compute[71364]:   <machine>pc-i440fx-6.2</machine>
Apr 11 21:45:51 user nova-compute[71364]:   <arch>x86_64</arch>
Apr 11 21:45:51 user nova-compute[71364]:   <vcpu max='255'/>
Apr 11 21:45:51 user nova-compute[71364]:   <iothreads supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:   <os supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='firmware'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>efi</value>
Apr 11 21:45:51 user nova-compute[71364]:     </enum>
Apr 11 21:45:51 user nova-compute[71364]:     <loader supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>rom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pflash</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='readonly'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>yes</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='secure'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </loader>
Apr 11 21:45:51 user nova-compute[71364]:   </os>
Apr 11 21:45:51 user nova-compute[71364]:   <cpu>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-passthrough' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='hostPassthroughMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>on</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='maximum' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='maximumMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>on</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-model' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <vendor>Intel</vendor>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ss'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='vmx'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='pcid'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='hypervisor'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arat'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='umip'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='md-clear'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='invtsc'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibpb'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibrs'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='rsba'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='erms'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='custom' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>qemu64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>qemu32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>phenom</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>n270</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>kvm64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>kvm32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>coreduo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>core2duo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>athlon</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Westmere</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Snowridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Penryn</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G5</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G4</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Opteron_G1</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Nehalem</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Rome</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Milan</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Dhyana</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cooperlake</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Conroe</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>486</model>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:   </cpu>
Apr 11 21:45:51 user nova-compute[71364]:   <memoryBacking supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='sourceType'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>file</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>anonymous</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>memfd</value>
Apr 11 21:45:51 user nova-compute[71364]:     </enum>
Apr 11 21:45:51 user nova-compute[71364]:   </memoryBacking>
Apr 11 21:45:51 user nova-compute[71364]:   <devices>
Apr 11 21:45:51 user nova-compute[71364]:     <disk supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='diskDevice'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>disk</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cdrom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>floppy</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>lun</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='bus'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>ide</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>fdc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sata</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </disk>
Apr 11 21:45:51 user nova-compute[71364]:     <graphics supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sdl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vnc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>spice</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egl-headless</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </graphics>
Apr 11 21:45:51 user nova-compute[71364]:     <video supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='modelType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cirrus</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vmvga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>qxl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>none</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>bochs</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>ramfb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </video>
Apr 11 21:45:51 user nova-compute[71364]:     <hostdev supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='mode'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>subsystem</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='startupPolicy'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>default</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>mandatory</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>requisite</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>optional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='subsysType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pci</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='capsType'/>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='pciBackend'/>
Apr 11 21:45:51 user nova-compute[71364]:     </hostdev>
Apr 11 21:45:51 user nova-compute[71364]:     <rng supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>random</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egd</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>builtin</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </rng>
Apr 11 21:45:51 user nova-compute[71364]:     <filesystem supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='driverType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>path</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>handle</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtiofs</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </filesystem>
Apr 11 21:45:51 user nova-compute[71364]:     <tpm supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-tis</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-crb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>passthrough</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>emulator</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </tpm>
Apr 11 21:45:51 user nova-compute[71364]:   </devices>
Apr 11 21:45:51 user nova-compute[71364]:   <features>
Apr 11 21:45:51 user nova-compute[71364]:     <gic supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     <vmcoreinfo supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <genid supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backingStoreInput supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backup supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <sev supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:   </features>
Apr 11 21:45:51 user nova-compute[71364]: </domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:  {{(pid=71364) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 11 21:45:51 user nova-compute[71364]: <domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 11 21:45:51 user nova-compute[71364]:   <domain>kvm</domain>
Apr 11 21:45:51 user nova-compute[71364]:   <machine>pc-q35-jammy</machine>
Apr 11 21:45:51 user nova-compute[71364]:   <arch>x86_64</arch>
Apr 11 21:45:51 user nova-compute[71364]:   <vcpu max='288'/>
Apr 11 21:45:51 user nova-compute[71364]:   <iothreads supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:   <os supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='firmware'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>efi</value>
Apr 11 21:45:51 user nova-compute[71364]:     </enum>
Apr 11 21:45:51 user nova-compute[71364]:     <loader supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>rom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pflash</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='readonly'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>yes</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='secure'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>yes</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>no</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </loader>
Apr 11 21:45:51 user nova-compute[71364]:   </os>
Apr 11 21:45:51 user nova-compute[71364]:   <cpu>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-passthrough' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='hostPassthroughMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>on</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='maximum' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='maximumMigratable'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>on</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>off</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='host-model' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <vendor>Intel</vendor>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ss'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='vmx'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='pcid'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='hypervisor'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arat'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='tsc_adjust'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='umip'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='md-clear'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='arch-capabilities'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='invtsc'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibpb'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='ibrs'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-stibp'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='amd-ssbd'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='rsba'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='require' name='pschange-mc-no'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='erms'/>
Apr 11 21:45:51 user nova-compute[71364]:       <feature policy='disable' name='xsaveopt'/>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:     <mode name='custom' supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>qemu64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>qemu32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>phenom</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>pentium</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>n270</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>kvm64</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>kvm32</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>coreduo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>core2duo</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>athlon</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Westmere-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Westmere</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Snowridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Skylake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>SandyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Penryn</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G5</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G4</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G3</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Opteron_G2</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Opteron_G1</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Nehalem</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>IvyBridge</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Icelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Haswell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Rome</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-Milan</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC-IBPB</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>EPYC</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Dhyana</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cooperlake</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>Conroe</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Cascadelake-Server</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-noTSX</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell-IBRS</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='no'>Broadwell</model>
Apr 11 21:45:51 user nova-compute[71364]:       <model usable='yes'>486</model>
Apr 11 21:45:51 user nova-compute[71364]:     </mode>
Apr 11 21:45:51 user nova-compute[71364]:   </cpu>
Apr 11 21:45:51 user nova-compute[71364]:   <memoryBacking supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:     <enum name='sourceType'>
Apr 11 21:45:51 user nova-compute[71364]:       <value>file</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>anonymous</value>
Apr 11 21:45:51 user nova-compute[71364]:       <value>memfd</value>
Apr 11 21:45:51 user nova-compute[71364]:     </enum>
Apr 11 21:45:51 user nova-compute[71364]:   </memoryBacking>
Apr 11 21:45:51 user nova-compute[71364]:   <devices>
Apr 11 21:45:51 user nova-compute[71364]:     <disk supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='diskDevice'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>disk</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cdrom</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>floppy</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>lun</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='bus'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>fdc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sata</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </disk>
Apr 11 21:45:51 user nova-compute[71364]:     <graphics supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='type'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>sdl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vnc</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>spice</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egl-headless</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </graphics>
Apr 11 21:45:51 user nova-compute[71364]:     <video supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='modelType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>cirrus</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>vmvga</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>qxl</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>none</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>bochs</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>ramfb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </video>
Apr 11 21:45:51 user nova-compute[71364]:     <hostdev supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='mode'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>subsystem</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='startupPolicy'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>default</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>mandatory</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>requisite</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>optional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='subsysType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>usb</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>pci</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>scsi</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='capsType'/>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='pciBackend'/>
Apr 11 21:45:51 user nova-compute[71364]:     </hostdev>
Apr 11 21:45:51 user nova-compute[71364]:     <rng supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtio-non-transitional</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>random</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>egd</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>builtin</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </rng>
Apr 11 21:45:51 user nova-compute[71364]:     <filesystem supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='driverType'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>path</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>handle</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>virtiofs</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </filesystem>
Apr 11 21:45:51 user nova-compute[71364]:     <tpm supported='yes'>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='model'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-tis</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>tpm-crb</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:       <enum name='backendModel'>
Apr 11 21:45:51 user nova-compute[71364]:         <value>passthrough</value>
Apr 11 21:45:51 user nova-compute[71364]:         <value>emulator</value>
Apr 11 21:45:51 user nova-compute[71364]:       </enum>
Apr 11 21:45:51 user nova-compute[71364]:     </tpm>
Apr 11 21:45:51 user nova-compute[71364]:   </devices>
Apr 11 21:45:51 user nova-compute[71364]:   <features>
Apr 11 21:45:51 user nova-compute[71364]:     <gic supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:     <vmcoreinfo supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <genid supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backingStoreInput supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <backup supported='yes'/>
Apr 11 21:45:51 user nova-compute[71364]:     <sev supported='no'/>
Apr 11 21:45:51 user nova-compute[71364]:   </features>
Apr 11 21:45:51 user nova-compute[71364]: </domainCapabilities>
Apr 11 21:45:51 user nova-compute[71364]:  {{(pid=71364) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71364) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71364) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Checking secure boot support for host arch (x86_64) {{(pid=71364) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 11 21:45:51 user nova-compute[71364]: INFO nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Secure Boot support detected
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] cpu compare xml: <cpu match="exact">
Apr 11 21:45:51 user nova-compute[71364]:   <model>Nehalem</model>
Apr 11 21:45:51 user nova-compute[71364]: </cpu>
Apr 11 21:45:51 user nova-compute[71364]:  {{(pid=71364) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 11 21:45:51 user nova-compute[71364]: INFO nova.virt.node [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Generated node identity c1fc3d49-a748-458e-8eba-ee7803982ec7
Apr 11 21:45:51 user nova-compute[71364]: INFO nova.virt.node [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Wrote node identity c1fc3d49-a748-458e-8eba-ee7803982ec7 to /opt/stack/data/nova/compute_id
Apr 11 21:45:51 user nova-compute[71364]: WARNING nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Compute nodes ['c1fc3d49-a748-458e-8eba-ee7803982ec7'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 11 21:45:51 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 11 21:45:51 user nova-compute[71364]: WARNING nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 11 21:45:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:45:51 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:45:51 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Hypervisor/Node resource view: name=user free_ram=10800MB free_disk=27.028114318847656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:45:51 user nova-compute[71364]: WARNING nova.compute.resource_tracker [None req-05447c97-6392-4206-9e03-ce397d44908a None None] No compute node record for user:c1fc3d49-a748-458e-8eba-ee7803982ec7: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host c1fc3d49-a748-458e-8eba-ee7803982ec7 could not be found.
Apr 11 21:45:51 user nova-compute[71364]: INFO nova.compute.resource_tracker [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Compute node record created for user:user with uuid: c1fc3d49-a748-458e-8eba-ee7803982ec7
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:45:51 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:45:51 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [req-a4279f97-69bb-4c2a-8a54-bcd2c100fb9f] Created resource provider record via placement API for resource provider with UUID c1fc3d49-a748-458e-8eba-ee7803982ec7 and name user.
Apr 11 21:45:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71364) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 11 21:45:52 user nova-compute[71364]: INFO nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] kernel doesn't support AMD SEV
Apr 11 21:45:52 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Updating inventory in ProviderTree for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 21:45:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:45:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Libvirt baseline CPU <cpu>
Apr 11 21:45:52 user nova-compute[71364]:   <arch>x86_64</arch>
Apr 11 21:45:52 user nova-compute[71364]:   <model>Nehalem</model>
Apr 11 21:45:52 user nova-compute[71364]:   <vendor>Intel</vendor>
Apr 11 21:45:52 user nova-compute[71364]:   <topology sockets="6" cores="1" threads="1"/>
Apr 11 21:45:52 user nova-compute[71364]: </cpu>
Apr 11 21:45:52 user nova-compute[71364]:  {{(pid=71364) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 11 21:45:52 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Updated inventory for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 11 21:45:52 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Updating resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7 generation from 0 to 1 during operation: update_inventory {{(pid=71364) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 11 21:45:52 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Updating inventory in ProviderTree for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 21:45:52 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Updating resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7 generation from 1 to 2 during operation: update_traits {{(pid=71364) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 11 21:45:52 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:45:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:45:52 user nova-compute[71364]: DEBUG nova.service [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Creating RPC server for service compute {{(pid=71364) start /opt/stack/nova/nova/service.py:182}}
Apr 11 21:45:52 user nova-compute[71364]: DEBUG nova.service [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Join ServiceGroup membership for this service compute {{(pid=71364) start /opt/stack/nova/nova/service.py:199}}
Apr 11 21:45:52 user nova-compute[71364]: DEBUG nova.servicegroup.drivers.db [None req-05447c97-6392-4206-9e03-ce397d44908a None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71364) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 11 21:46:26 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:46:26 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Didn't find any instances for network info cache update. {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:46:43 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:46:43 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:46:43 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=10170MB free_disk=26.941898345947266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:46:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.310s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:47:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:47:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:47:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:47:44 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:47:44 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:47:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:47:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:47:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Didn't find any instances for network info cache update. {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 21:47:44 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:47:44 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:47:44 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:47:44 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:47:45 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:47:45 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:47:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:47:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:47:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:47:45 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:47:45 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:47:45 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:47:45 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=10168MB free_disk=26.985748291015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:47:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:47:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:47:45 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:47:45 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:47:45 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:47:45 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:47:45 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:47:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:48:44 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:48:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:48:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:48:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Didn't find any instances for network info cache update. {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 21:48:44 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:48:45 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:48:45 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:48:45 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:48:45 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:48:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:48:46 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:48:46 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:48:47 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:48:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:48:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:48:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:48:47 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:48:47 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:48:47 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:48:47 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=10134MB free_disk=26.763919830322266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:48:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:48:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:48:47 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:48:47 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:48:47 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:48:47 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:48:47 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:48:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.094s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:49:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:49:44 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:49:45 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:49:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:49:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:49:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Didn't find any instances for network info cache update. {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 21:49:45 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:49:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:49:46 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:49:46 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:49:46 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:49:47 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:49:47 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:49:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:49:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:49:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:49:47 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:49:47 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:49:47 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:49:47 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=9422MB free_disk=26.785892486572266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:49:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:49:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:49:47 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:49:47 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:49:47 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:49:47 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:49:47 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:49:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:49:48 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:49:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:49:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:49:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:49:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:49:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:49:57 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:49:57 user nova-compute[71364]: INFO nova.compute.claims [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Claim successful on node user
Apr 11 21:49:57 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:49:57 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:49:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:49:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:49:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:49:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:49:58 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:49:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:49:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:49:58 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:49:58 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Creating image(s)
Apr 11 21:49:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "/opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:49:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "/opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:49:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "/opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:49:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:49:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:49:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793.part --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:49:59 user nova-compute[71364]: DEBUG nova.policy [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '839497b8586f4d9c8cc849e1de31c0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db880c2bdad74479a85e926c37352962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:49:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793.part --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:49:59 user nova-compute[71364]: DEBUG nova.virt.images [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] ca576860-9db2-47a8-a5c5-dc172050b182 was qcow2, converting to raw {{(pid=71364) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 21:49:59 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 21:49:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793.part /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793.converted {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:49:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793.part /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793.converted" returned: 0 in 0.225s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:49:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793.converted --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:49:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:49:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.278s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:49:59 user nova-compute[71364]: INFO oslo.privsep.daemon [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptqwpujvc/privsep.sock']
Apr 11 21:49:59 user sudo[80085]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptqwpujvc/privsep.sock
Apr 11 21:49:59 user sudo[80085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 21:50:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "13124f93-665b-4107-bd71-16674bdb9a64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "13124f93-665b-4107-bd71-16674bdb9a64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:50:00 user nova-compute[71364]: INFO nova.compute.claims [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Claim successful on node user
Apr 11 21:50:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Successfully created port: f34feb75-3b0a-4198-bdcb-0eaf289e96fb {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:50:00 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:50:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:50:00 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Creating image(s)
Apr 11 21:50:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "/opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "/opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "/opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:00 user nova-compute[71364]: DEBUG nova.policy [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6660fbfd58b54271b92500f76759f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93062d2dda5548e5b9a7dabe2f69b094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:50:01 user sudo[80085]: pam_unix(sudo:session): session closed for user root
Apr 11 21:50:01 user nova-compute[71364]: INFO oslo.privsep.daemon [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Spawned new privsep daemon via rootwrap
Apr 11 21:50:01 user nova-compute[71364]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 21:50:01 user nova-compute[71364]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 21:50:01 user nova-compute[71364]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 11 21:50:01 user nova-compute[71364]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80090
Apr 11 21:50:01 user nova-compute[71364]: WARNING oslo_privsep.priv_context [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] privsep daemon already running
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk 1073741824" returned: 0 in 0.048s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.192s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.163s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk 1073741824" returned: 0 in 0.041s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Cannot resize image /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.objects.instance [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lazy-loading 'migration_context' on Instance uuid 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Ensure instance console log exists: /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.158s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Cannot resize image /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.objects.instance [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lazy-loading 'migration_context' on Instance uuid 13124f93-665b-4107-bd71-16674bdb9a64 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Ensure instance console log exists: /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Successfully updated port: f34feb75-3b0a-4198-bdcb-0eaf289e96fb {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "refresh_cache-514f5cac-9b1d-42e9-9619-0a2ce6c82b14" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquired lock "refresh_cache-514f5cac-9b1d-42e9-9619-0a2ce6c82b14" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.network.neutron [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Successfully created port: 9e4da68e-e9a4-4d29-b326-bc52cad55a93 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.compute.manager [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Received event network-changed-f34feb75-3b0a-4198-bdcb-0eaf289e96fb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG nova.compute.manager [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Refreshing instance network info cache due to event network-changed-f34feb75-3b0a-4198-bdcb-0eaf289e96fb. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:50:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] Acquiring lock "refresh_cache-514f5cac-9b1d-42e9-9619-0a2ce6c82b14" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "e627de16-3a8f-4510-8001-0e57a272b859" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:50:03 user nova-compute[71364]: INFO nova.compute.claims [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Claim successful on node user
Apr 11 21:50:03 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:50:03 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:50:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:50:03 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Creating image(s)
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "/opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "/opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "/opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:50:03 user nova-compute[71364]: INFO nova.compute.claims [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Claim successful on node user
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:03 user nova-compute[71364]: DEBUG nova.policy [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '176bb0cf6ea849bfbe97f8275ec2f932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a0320bbd424d039ac56f377f51132d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.163s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk 1073741824" returned: 0 in 0.053s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Updating instance_info_cache with network_info: [{"id": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "address": "fa:16:3e:85:6d:26", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34feb75-3b", "ovs_interfaceid": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Releasing lock "refresh_cache-514f5cac-9b1d-42e9-9619-0a2ce6c82b14" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Instance network_info: |[{"id": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "address": "fa:16:3e:85:6d:26", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34feb75-3b", "ovs_interfaceid": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] Acquired lock "refresh_cache-514f5cac-9b1d-42e9-9619-0a2ce6c82b14" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.network.neutron [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Refreshing network info cache for port f34feb75-3b0a-4198-bdcb-0eaf289e96fb {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Start _get_guest_xml network_info=[{"id": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "address": "fa:16:3e:85:6d:26", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34feb75-3b", "ovs_interfaceid": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:50:04 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:04 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1737937747',display_name='tempest-ServersNegativeTestJSON-server-1737937747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1737937747',id=1,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db880c2bdad74479a85e926c37352962',ramdisk_id='',reservation_id='r-7e0ui3hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-46827538',owner_user_name='tempest-ServersNegativeTestJSON-46827538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:49:58Z,user_data=None,user_id='839497b8586f4d9c8cc849e1de31c0e9',uuid=514f5cac-9b1d-42e9-9619-0a2ce6c82b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "address": "fa:16:3e:85:6d:26", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34feb75-3b", "ovs_interfaceid": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Converting VIF {"id": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "address": "fa:16:3e:85:6d:26", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34feb75-3b", "ovs_interfaceid": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:6d:26,bridge_name='br-int',has_traffic_filtering=True,id=f34feb75-3b0a-4198-bdcb-0eaf289e96fb,network=Network(e7c6d356-dca6-4d85-ac96-dc14b5e5993d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34feb75-3b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.objects.instance [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lazy-loading 'pci_devices' on Instance uuid 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.202s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.network.neutron [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:04 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:50:04 user nova-compute[71364]:   <uuid>514f5cac-9b1d-42e9-9619-0a2ce6c82b14</uuid>
Apr 11 21:50:04 user nova-compute[71364]:   <name>instance-00000001</name>
Apr 11 21:50:04 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:50:04 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:50:04 user nova-compute[71364]:   <metadata>
Apr 11 21:50:04 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:50:04 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:50:04 user nova-compute[71364]:       <nova:name>tempest-ServersNegativeTestJSON-server-1737937747</nova:name>
Apr 11 21:50:04 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:50:04</nova:creationTime>
Apr 11 21:50:04 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:50:04 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:50:04 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:50:04 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:50:04 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:50:04 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:50:04 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:50:04 user nova-compute[71364]:       <nova:owner>
Apr 11 21:50:04 user nova-compute[71364]:         <nova:user uuid="839497b8586f4d9c8cc849e1de31c0e9">tempest-ServersNegativeTestJSON-46827538-project-member</nova:user>
Apr 11 21:50:04 user nova-compute[71364]:         <nova:project uuid="db880c2bdad74479a85e926c37352962">tempest-ServersNegativeTestJSON-46827538</nova:project>
Apr 11 21:50:04 user nova-compute[71364]:       </nova:owner>
Apr 11 21:50:04 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:50:04 user nova-compute[71364]:       <nova:ports>
Apr 11 21:50:04 user nova-compute[71364]:         <nova:port uuid="f34feb75-3b0a-4198-bdcb-0eaf289e96fb">
Apr 11 21:50:04 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 21:50:04 user nova-compute[71364]:         </nova:port>
Apr 11 21:50:04 user nova-compute[71364]:       </nova:ports>
Apr 11 21:50:04 user nova-compute[71364]:     </nova:instance>
Apr 11 21:50:04 user nova-compute[71364]:   </metadata>
Apr 11 21:50:04 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:50:04 user nova-compute[71364]:     <system>
Apr 11 21:50:04 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:50:04 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:50:04 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:50:04 user nova-compute[71364]:       <entry name="serial">514f5cac-9b1d-42e9-9619-0a2ce6c82b14</entry>
Apr 11 21:50:04 user nova-compute[71364]:       <entry name="uuid">514f5cac-9b1d-42e9-9619-0a2ce6c82b14</entry>
Apr 11 21:50:04 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:50:04 user nova-compute[71364]:     </system>
Apr 11 21:50:04 user nova-compute[71364]:   </sysinfo>
Apr 11 21:50:04 user nova-compute[71364]:   <os>
Apr 11 21:50:04 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:50:04 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:50:04 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:50:04 user nova-compute[71364]:   </os>
Apr 11 21:50:04 user nova-compute[71364]:   <features>
Apr 11 21:50:04 user nova-compute[71364]:     <acpi/>
Apr 11 21:50:04 user nova-compute[71364]:     <apic/>
Apr 11 21:50:04 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:50:04 user nova-compute[71364]:   </features>
Apr 11 21:50:04 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:50:04 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:50:04 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:50:04 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:50:04 user nova-compute[71364]:   </clock>
Apr 11 21:50:04 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:50:04 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:50:04 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:50:04 user nova-compute[71364]:   </cpu>
Apr 11 21:50:04 user nova-compute[71364]:   <devices>
Apr 11 21:50:04 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:50:04 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:50:04 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk"/>
Apr 11 21:50:04 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:50:04 user nova-compute[71364]:     </disk>
Apr 11 21:50:04 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:50:04 user nova-compute[71364]:       <mac address="fa:16:3e:85:6d:26"/>
Apr 11 21:50:04 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:04 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:50:04 user nova-compute[71364]:       <target dev="tapf34feb75-3b"/>
Apr 11 21:50:04 user nova-compute[71364]:     </interface>
Apr 11 21:50:04 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:50:04 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/console.log" append="off"/>
Apr 11 21:50:04 user nova-compute[71364]:     </serial>
Apr 11 21:50:04 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:50:04 user nova-compute[71364]:     <video>
Apr 11 21:50:04 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:04 user nova-compute[71364]:     </video>
Apr 11 21:50:04 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:50:04 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:50:04 user nova-compute[71364]:     </rng>
Apr 11 21:50:04 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:50:04 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:50:04 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:50:04 user nova-compute[71364]:     </memballoon>
Apr 11 21:50:04 user nova-compute[71364]:   </devices>
Apr 11 21:50:04 user nova-compute[71364]: </domain>
Apr 11 21:50:04 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1737937747',display_name='tempest-ServersNegativeTestJSON-server-1737937747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1737937747',id=1,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db880c2bdad74479a85e926c37352962',ramdisk_id='',reservation_id='r-7e0ui3hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-46827538',owner_user_name='tempest-ServersNegativeTestJSON-46827538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:49:58Z,user_data=None,user_id='839497b8586f4d9c8cc849e1de31c0e9',uuid=514f5cac-9b1d-42e9-9619-0a2ce6c82b14,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "address": "fa:16:3e:85:6d:26", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34feb75-3b", "ovs_interfaceid": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Converting VIF {"id": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "address": "fa:16:3e:85:6d:26", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34feb75-3b", "ovs_interfaceid": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:6d:26,bridge_name='br-int',has_traffic_filtering=True,id=f34feb75-3b0a-4198-bdcb-0eaf289e96fb,network=Network(e7c6d356-dca6-4d85-ac96-dc14b5e5993d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34feb75-3b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG os_vif [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:6d:26,bridge_name='br-int',has_traffic_filtering=True,id=f34feb75-3b0a-4198-bdcb-0eaf289e96fb,network=Network(e7c6d356-dca6-4d85-ac96-dc14b5e5993d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34feb75-3b') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Created schema index Interface.name {{(pid=71364) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Created schema index Port.name {{(pid=71364) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Created schema index Bridge.name {{(pid=71364) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [POLLOUT] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.policy [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Cannot resize image /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'migration_context' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Ensure instance console log exists: /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:50:04 user nova-compute[71364]: INFO oslo.privsep.daemon [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpj2t8f1o2/privsep.sock']
Apr 11 21:50:04 user sudo[80150]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpj2t8f1o2/privsep.sock
Apr 11 21:50:04 user sudo[80150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:50:04 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Creating image(s)
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "/opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "/opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk 1073741824" returned: 0 in 0.052s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:05 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:50:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:05 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Cannot resize image /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:50:05 user nova-compute[71364]: DEBUG nova.objects.instance [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'migration_context' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:50:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Ensure instance console log exists: /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:50:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:06 user sudo[80150]: pam_unix(sudo:session): session closed for user root
Apr 11 21:50:06 user nova-compute[71364]: INFO oslo.privsep.daemon [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Spawned new privsep daemon via rootwrap
Apr 11 21:50:06 user nova-compute[71364]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 21:50:06 user nova-compute[71364]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 21:50:06 user nova-compute[71364]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 11 21:50:06 user nova-compute[71364]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80168
Apr 11 21:50:06 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Successfully created port: 20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG nova.network.neutron [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Updated VIF entry in instance network info cache for port f34feb75-3b0a-4198-bdcb-0eaf289e96fb. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG nova.network.neutron [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Updating instance_info_cache with network_info: [{"id": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "address": "fa:16:3e:85:6d:26", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34feb75-3b", "ovs_interfaceid": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG nova.network.neutron [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Successfully updated port: 9e4da68e-e9a4-4d29-b326-bc52cad55a93 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] Releasing lock "refresh_cache-514f5cac-9b1d-42e9-9619-0a2ce6c82b14" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "refresh_cache-13124f93-665b-4107-bd71-16674bdb9a64" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquired lock "refresh_cache-13124f93-665b-4107-bd71-16674bdb9a64" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG nova.network.neutron [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf34feb75-3b, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf34feb75-3b, col_values=(('external_ids', {'iface-id': 'f34feb75-3b0a-4198-bdcb-0eaf289e96fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:6d:26', 'vm-uuid': '514f5cac-9b1d-42e9-9619-0a2ce6c82b14'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG nova.network.neutron [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Successfully created port: 6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:50:06 user nova-compute[71364]: INFO os_vif [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:6d:26,bridge_name='br-int',has_traffic_filtering=True,id=f34feb75-3b0a-4198-bdcb-0eaf289e96fb,network=Network(e7c6d356-dca6-4d85-ac96-dc14b5e5993d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34feb75-3b')
Apr 11 21:50:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Received event network-changed-9e4da68e-e9a4-4d29-b326-bc52cad55a93 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Refreshing instance network info cache due to event network-changed-9e4da68e-e9a4-4d29-b326-bc52cad55a93. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] Acquiring lock "refresh_cache-13124f93-665b-4107-bd71-16674bdb9a64" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] No VIF found with MAC fa:16:3e:85:6d:26, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:50:06 user nova-compute[71364]: DEBUG nova.network.neutron [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:50:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.network.neutron [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Updating instance_info_cache with network_info: [{"id": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "address": "fa:16:3e:0d:61:f9", "network": {"id": "93e24ee9-e650-404a-8b5d-680ca2e1e132", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1215474541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93062d2dda5548e5b9a7dabe2f69b094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4da68e-e9", "ovs_interfaceid": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Releasing lock "refresh_cache-13124f93-665b-4107-bd71-16674bdb9a64" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Instance network_info: |[{"id": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "address": "fa:16:3e:0d:61:f9", "network": {"id": "93e24ee9-e650-404a-8b5d-680ca2e1e132", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1215474541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93062d2dda5548e5b9a7dabe2f69b094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4da68e-e9", "ovs_interfaceid": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] Acquired lock "refresh_cache-13124f93-665b-4107-bd71-16674bdb9a64" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.network.neutron [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Refreshing network info cache for port 9e4da68e-e9a4-4d29-b326-bc52cad55a93 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Start _get_guest_xml network_info=[{"id": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "address": "fa:16:3e:0d:61:f9", "network": {"id": "93e24ee9-e650-404a-8b5d-680ca2e1e132", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1215474541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93062d2dda5548e5b9a7dabe2f69b094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4da68e-e9", "ovs_interfaceid": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:50:08 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:08 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-789334926',display_name='tempest-DeleteServersTestJSON-server-789334926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-789334926',id=2,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93062d2dda5548e5b9a7dabe2f69b094',ramdisk_id='',reservation_id='r-tcu7akj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-141105202',owner_user_name='tempest-DeleteServersTestJSON-141105202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:50:01Z,user_data=None,user_id='6660fbfd58b54271b92500f76759f362',uuid=13124f93-665b-4107-bd71-16674bdb9a64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "address": "fa:16:3e:0d:61:f9", "network": {"id": "93e24ee9-e650-404a-8b5d-680ca2e1e132", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1215474541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93062d2dda5548e5b9a7dabe2f69b094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4da68e-e9", "ovs_interfaceid": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Converting VIF {"id": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "address": "fa:16:3e:0d:61:f9", "network": {"id": "93e24ee9-e650-404a-8b5d-680ca2e1e132", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1215474541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93062d2dda5548e5b9a7dabe2f69b094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4da68e-e9", "ovs_interfaceid": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:61:f9,bridge_name='br-int',has_traffic_filtering=True,id=9e4da68e-e9a4-4d29-b326-bc52cad55a93,network=Network(93e24ee9-e650-404a-8b5d-680ca2e1e132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4da68e-e9') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.objects.instance [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lazy-loading 'pci_devices' on Instance uuid 13124f93-665b-4107-bd71-16674bdb9a64 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:50:08 user nova-compute[71364]:   <uuid>13124f93-665b-4107-bd71-16674bdb9a64</uuid>
Apr 11 21:50:08 user nova-compute[71364]:   <name>instance-00000002</name>
Apr 11 21:50:08 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:50:08 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:50:08 user nova-compute[71364]:   <metadata>
Apr 11 21:50:08 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:50:08 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:50:08 user nova-compute[71364]:       <nova:name>tempest-DeleteServersTestJSON-server-789334926</nova:name>
Apr 11 21:50:08 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:50:08</nova:creationTime>
Apr 11 21:50:08 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:50:08 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:50:08 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:50:08 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:50:08 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:50:08 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:50:08 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:50:08 user nova-compute[71364]:       <nova:owner>
Apr 11 21:50:08 user nova-compute[71364]:         <nova:user uuid="6660fbfd58b54271b92500f76759f362">tempest-DeleteServersTestJSON-141105202-project-member</nova:user>
Apr 11 21:50:08 user nova-compute[71364]:         <nova:project uuid="93062d2dda5548e5b9a7dabe2f69b094">tempest-DeleteServersTestJSON-141105202</nova:project>
Apr 11 21:50:08 user nova-compute[71364]:       </nova:owner>
Apr 11 21:50:08 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:50:08 user nova-compute[71364]:       <nova:ports>
Apr 11 21:50:08 user nova-compute[71364]:         <nova:port uuid="9e4da68e-e9a4-4d29-b326-bc52cad55a93">
Apr 11 21:50:08 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 21:50:08 user nova-compute[71364]:         </nova:port>
Apr 11 21:50:08 user nova-compute[71364]:       </nova:ports>
Apr 11 21:50:08 user nova-compute[71364]:     </nova:instance>
Apr 11 21:50:08 user nova-compute[71364]:   </metadata>
Apr 11 21:50:08 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:50:08 user nova-compute[71364]:     <system>
Apr 11 21:50:08 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:50:08 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:50:08 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:50:08 user nova-compute[71364]:       <entry name="serial">13124f93-665b-4107-bd71-16674bdb9a64</entry>
Apr 11 21:50:08 user nova-compute[71364]:       <entry name="uuid">13124f93-665b-4107-bd71-16674bdb9a64</entry>
Apr 11 21:50:08 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:50:08 user nova-compute[71364]:     </system>
Apr 11 21:50:08 user nova-compute[71364]:   </sysinfo>
Apr 11 21:50:08 user nova-compute[71364]:   <os>
Apr 11 21:50:08 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:50:08 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:50:08 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:50:08 user nova-compute[71364]:   </os>
Apr 11 21:50:08 user nova-compute[71364]:   <features>
Apr 11 21:50:08 user nova-compute[71364]:     <acpi/>
Apr 11 21:50:08 user nova-compute[71364]:     <apic/>
Apr 11 21:50:08 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:50:08 user nova-compute[71364]:   </features>
Apr 11 21:50:08 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:50:08 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:50:08 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:50:08 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:50:08 user nova-compute[71364]:   </clock>
Apr 11 21:50:08 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:50:08 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:50:08 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:50:08 user nova-compute[71364]:   </cpu>
Apr 11 21:50:08 user nova-compute[71364]:   <devices>
Apr 11 21:50:08 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:50:08 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:50:08 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk"/>
Apr 11 21:50:08 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:50:08 user nova-compute[71364]:     </disk>
Apr 11 21:50:08 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:50:08 user nova-compute[71364]:       <mac address="fa:16:3e:0d:61:f9"/>
Apr 11 21:50:08 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:08 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:50:08 user nova-compute[71364]:       <target dev="tap9e4da68e-e9"/>
Apr 11 21:50:08 user nova-compute[71364]:     </interface>
Apr 11 21:50:08 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:50:08 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/console.log" append="off"/>
Apr 11 21:50:08 user nova-compute[71364]:     </serial>
Apr 11 21:50:08 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:50:08 user nova-compute[71364]:     <video>
Apr 11 21:50:08 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:08 user nova-compute[71364]:     </video>
Apr 11 21:50:08 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:50:08 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:50:08 user nova-compute[71364]:     </rng>
Apr 11 21:50:08 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:50:08 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:50:08 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:50:08 user nova-compute[71364]:     </memballoon>
Apr 11 21:50:08 user nova-compute[71364]:   </devices>
Apr 11 21:50:08 user nova-compute[71364]: </domain>
Apr 11 21:50:08 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-789334926',display_name='tempest-DeleteServersTestJSON-server-789334926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-789334926',id=2,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93062d2dda5548e5b9a7dabe2f69b094',ramdisk_id='',reservation_id='r-tcu7akj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-141105202',owner_user_name='tempest-DeleteServersTestJSON-141105202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:50:01Z,user_data=None,user_id='6660fbfd58b54271b92500f76759f362',uuid=13124f93-665b-4107-bd71-16674bdb9a64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "address": "fa:16:3e:0d:61:f9", "network": {"id": "93e24ee9-e650-404a-8b5d-680ca2e1e132", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1215474541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93062d2dda5548e5b9a7dabe2f69b094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4da68e-e9", "ovs_interfaceid": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Converting VIF {"id": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "address": "fa:16:3e:0d:61:f9", "network": {"id": "93e24ee9-e650-404a-8b5d-680ca2e1e132", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1215474541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93062d2dda5548e5b9a7dabe2f69b094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4da68e-e9", "ovs_interfaceid": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:61:f9,bridge_name='br-int',has_traffic_filtering=True,id=9e4da68e-e9a4-4d29-b326-bc52cad55a93,network=Network(93e24ee9-e650-404a-8b5d-680ca2e1e132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4da68e-e9') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG os_vif [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:61:f9,bridge_name='br-int',has_traffic_filtering=True,id=9e4da68e-e9a4-4d29-b326-bc52cad55a93,network=Network(93e24ee9-e650-404a-8b5d-680ca2e1e132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4da68e-e9') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e4da68e-e9, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e4da68e-e9, col_values=(('external_ids', {'iface-id': '9e4da68e-e9a4-4d29-b326-bc52cad55a93', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:61:f9', 'vm-uuid': '13124f93-665b-4107-bd71-16674bdb9a64'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:08 user nova-compute[71364]: INFO os_vif [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:61:f9,bridge_name='br-int',has_traffic_filtering=True,id=9e4da68e-e9a4-4d29-b326-bc52cad55a93,network=Network(93e24ee9-e650-404a-8b5d-680ca2e1e132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4da68e-e9')
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] No VIF found with MAC fa:16:3e:0d:61:f9, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Successfully updated port: 20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquired lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-7df2e8a9-40c0-4e05-b3ba-6db97edd8a8e req-b0b0cc95-9b35-4916-add4-f9515cf1b524 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-changed-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-7df2e8a9-40c0-4e05-b3ba-6db97edd8a8e req-b0b0cc95-9b35-4916-add4-f9515cf1b524 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Refreshing instance network info cache due to event network-changed-20b9e448-55b1-49a6-8c39-08b2ab9755eb. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7df2e8a9-40c0-4e05-b3ba-6db97edd8a8e req-b0b0cc95-9b35-4916-add4-f9515cf1b524 service nova] Acquiring lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.network.neutron [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Successfully updated port: 6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquired lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.network.neutron [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.network.neutron [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-changed-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Refreshing instance network info cache due to event network-changed-6144f13d-b463-46ef-b75b-d2d982198b72. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] Acquiring lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updating instance_info_cache with network_info: [{"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Releasing lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Instance network_info: |[{"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7df2e8a9-40c0-4e05-b3ba-6db97edd8a8e req-b0b0cc95-9b35-4916-add4-f9515cf1b524 service nova] Acquired lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.network.neutron [req-7df2e8a9-40c0-4e05-b3ba-6db97edd8a8e req-b0b0cc95-9b35-4916-add4-f9515cf1b524 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Refreshing network info cache for port 20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Start _get_guest_xml network_info=[{"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:09 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:09 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-405286600',display_name='tempest-ServerStableDeviceRescueTest-server-405286600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-405286600',id=3,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8UEH6m5UnzB3x3GKZuWdKxk/7Mog1k30VHYME5xmsB2oMV/EGVRbZfXe3hxruVI/c3+NH5gZP1pkgcqm0HyGY2eX0pPoQEeEsvHRlFY/LgN3qSuIuwhuAHFHFnkPGb1w==',key_name='tempest-keypair-301380016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2a0320bbd424d039ac56f377f51132d',ramdisk_id='',reservation_id='r-qbwexep8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1504592746',owner_user_name='tempest-ServerStableDeviceRescueTest-1504592746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:50:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='176bb0cf6ea849bfbe97f8275ec2f932',uuid=e627de16-3a8f-4510-8001-0e57a272b859,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Converting VIF {"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:93,bridge_name='br-int',has_traffic_filtering=True,id=20b9e448-55b1-49a6-8c39-08b2ab9755eb,network=Network(a9945e2c-fe10-4952-83c1-81f938544bce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b9e448-55') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'pci_devices' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:50:09 user nova-compute[71364]:   <uuid>e627de16-3a8f-4510-8001-0e57a272b859</uuid>
Apr 11 21:50:09 user nova-compute[71364]:   <name>instance-00000003</name>
Apr 11 21:50:09 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:50:09 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:50:09 user nova-compute[71364]:   <metadata>
Apr 11 21:50:09 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:50:09 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:50:09 user nova-compute[71364]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-405286600</nova:name>
Apr 11 21:50:09 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:50:09</nova:creationTime>
Apr 11 21:50:09 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:50:09 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:50:09 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:50:09 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:50:09 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:50:09 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:50:09 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:50:09 user nova-compute[71364]:       <nova:owner>
Apr 11 21:50:09 user nova-compute[71364]:         <nova:user uuid="176bb0cf6ea849bfbe97f8275ec2f932">tempest-ServerStableDeviceRescueTest-1504592746-project-member</nova:user>
Apr 11 21:50:09 user nova-compute[71364]:         <nova:project uuid="b2a0320bbd424d039ac56f377f51132d">tempest-ServerStableDeviceRescueTest-1504592746</nova:project>
Apr 11 21:50:09 user nova-compute[71364]:       </nova:owner>
Apr 11 21:50:09 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:50:09 user nova-compute[71364]:       <nova:ports>
Apr 11 21:50:09 user nova-compute[71364]:         <nova:port uuid="20b9e448-55b1-49a6-8c39-08b2ab9755eb">
Apr 11 21:50:09 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 21:50:09 user nova-compute[71364]:         </nova:port>
Apr 11 21:50:09 user nova-compute[71364]:       </nova:ports>
Apr 11 21:50:09 user nova-compute[71364]:     </nova:instance>
Apr 11 21:50:09 user nova-compute[71364]:   </metadata>
Apr 11 21:50:09 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:50:09 user nova-compute[71364]:     <system>
Apr 11 21:50:09 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:50:09 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:50:09 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:50:09 user nova-compute[71364]:       <entry name="serial">e627de16-3a8f-4510-8001-0e57a272b859</entry>
Apr 11 21:50:09 user nova-compute[71364]:       <entry name="uuid">e627de16-3a8f-4510-8001-0e57a272b859</entry>
Apr 11 21:50:09 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:50:09 user nova-compute[71364]:     </system>
Apr 11 21:50:09 user nova-compute[71364]:   </sysinfo>
Apr 11 21:50:09 user nova-compute[71364]:   <os>
Apr 11 21:50:09 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:50:09 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:50:09 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:50:09 user nova-compute[71364]:   </os>
Apr 11 21:50:09 user nova-compute[71364]:   <features>
Apr 11 21:50:09 user nova-compute[71364]:     <acpi/>
Apr 11 21:50:09 user nova-compute[71364]:     <apic/>
Apr 11 21:50:09 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:50:09 user nova-compute[71364]:   </features>
Apr 11 21:50:09 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:50:09 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:50:09 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:50:09 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:50:09 user nova-compute[71364]:   </clock>
Apr 11 21:50:09 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:50:09 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:50:09 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:50:09 user nova-compute[71364]:   </cpu>
Apr 11 21:50:09 user nova-compute[71364]:   <devices>
Apr 11 21:50:09 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:50:09 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:50:09 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk"/>
Apr 11 21:50:09 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:50:09 user nova-compute[71364]:     </disk>
Apr 11 21:50:09 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:50:09 user nova-compute[71364]:       <mac address="fa:16:3e:3e:1d:93"/>
Apr 11 21:50:09 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:09 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:50:09 user nova-compute[71364]:       <target dev="tap20b9e448-55"/>
Apr 11 21:50:09 user nova-compute[71364]:     </interface>
Apr 11 21:50:09 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:50:09 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/console.log" append="off"/>
Apr 11 21:50:09 user nova-compute[71364]:     </serial>
Apr 11 21:50:09 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:50:09 user nova-compute[71364]:     <video>
Apr 11 21:50:09 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:09 user nova-compute[71364]:     </video>
Apr 11 21:50:09 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:50:09 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:50:09 user nova-compute[71364]:     </rng>
Apr 11 21:50:09 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:50:09 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:50:09 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:50:09 user nova-compute[71364]:     </memballoon>
Apr 11 21:50:09 user nova-compute[71364]:   </devices>
Apr 11 21:50:09 user nova-compute[71364]: </domain>
Apr 11 21:50:09 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-405286600',display_name='tempest-ServerStableDeviceRescueTest-server-405286600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-405286600',id=3,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8UEH6m5UnzB3x3GKZuWdKxk/7Mog1k30VHYME5xmsB2oMV/EGVRbZfXe3hxruVI/c3+NH5gZP1pkgcqm0HyGY2eX0pPoQEeEsvHRlFY/LgN3qSuIuwhuAHFHFnkPGb1w==',key_name='tempest-keypair-301380016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2a0320bbd424d039ac56f377f51132d',ramdisk_id='',reservation_id='r-qbwexep8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1504592746',owner_user_name='tempest-ServerStableDeviceRescueTest-1504592746-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:50:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='176bb0cf6ea849bfbe97f8275ec2f932',uuid=e627de16-3a8f-4510-8001-0e57a272b859,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Converting VIF {"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:93,bridge_name='br-int',has_traffic_filtering=True,id=20b9e448-55b1-49a6-8c39-08b2ab9755eb,network=Network(a9945e2c-fe10-4952-83c1-81f938544bce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b9e448-55') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG os_vif [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:93,bridge_name='br-int',has_traffic_filtering=True,id=20b9e448-55b1-49a6-8c39-08b2ab9755eb,network=Network(a9945e2c-fe10-4952-83c1-81f938544bce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b9e448-55') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20b9e448-55, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20b9e448-55, col_values=(('external_ids', {'iface-id': '20b9e448-55b1-49a6-8c39-08b2ab9755eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:1d:93', 'vm-uuid': 'e627de16-3a8f-4510-8001-0e57a272b859'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:50:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:09 user nova-compute[71364]: INFO os_vif [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:93,bridge_name='br-int',has_traffic_filtering=True,id=20b9e448-55b1-49a6-8c39-08b2ab9755eb,network=Network(a9945e2c-fe10-4952-83c1-81f938544bce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b9e448-55')
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] No VIF found with MAC fa:16:3e:3e:1d:93, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.network.neutron [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Updated VIF entry in instance network info cache for port 9e4da68e-e9a4-4d29-b326-bc52cad55a93. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.network.neutron [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Updating instance_info_cache with network_info: [{"id": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "address": "fa:16:3e:0d:61:f9", "network": {"id": "93e24ee9-e650-404a-8b5d-680ca2e1e132", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1215474541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93062d2dda5548e5b9a7dabe2f69b094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4da68e-e9", "ovs_interfaceid": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] Releasing lock "refresh_cache-13124f93-665b-4107-bd71-16674bdb9a64" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.network.neutron [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating instance_info_cache with network_info: [{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Releasing lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance network_info: |[{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] Acquired lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.network.neutron [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Refreshing network info cache for port 6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Start _get_guest_xml network_info=[{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:50:10 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:10 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842337295',display_name='tempest-ServerActionsTestJSON-server-1842337295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842337295',id=4,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-c34k408a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=5ff9bbaf-1a5e-4acd-aca3-d956728312cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.objects.instance [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:50:10 user nova-compute[71364]:   <uuid>5ff9bbaf-1a5e-4acd-aca3-d956728312cb</uuid>
Apr 11 21:50:10 user nova-compute[71364]:   <name>instance-00000004</name>
Apr 11 21:50:10 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:50:10 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:50:10 user nova-compute[71364]:   <metadata>
Apr 11 21:50:10 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:50:10 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:50:10 user nova-compute[71364]:       <nova:name>tempest-ServerActionsTestJSON-server-1842337295</nova:name>
Apr 11 21:50:10 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:50:10</nova:creationTime>
Apr 11 21:50:10 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:50:10 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:50:10 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:50:10 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:50:10 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:50:10 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:50:10 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:50:10 user nova-compute[71364]:       <nova:owner>
Apr 11 21:50:10 user nova-compute[71364]:         <nova:user uuid="939785ef89cb491aae3df4f411b2543d">tempest-ServerActionsTestJSON-434853204-project-member</nova:user>
Apr 11 21:50:10 user nova-compute[71364]:         <nova:project uuid="c9fff7d112a94e7da6bf166a6f628fed">tempest-ServerActionsTestJSON-434853204</nova:project>
Apr 11 21:50:10 user nova-compute[71364]:       </nova:owner>
Apr 11 21:50:10 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:50:10 user nova-compute[71364]:       <nova:ports>
Apr 11 21:50:10 user nova-compute[71364]:         <nova:port uuid="6144f13d-b463-46ef-b75b-d2d982198b72">
Apr 11 21:50:10 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 21:50:10 user nova-compute[71364]:         </nova:port>
Apr 11 21:50:10 user nova-compute[71364]:       </nova:ports>
Apr 11 21:50:10 user nova-compute[71364]:     </nova:instance>
Apr 11 21:50:10 user nova-compute[71364]:   </metadata>
Apr 11 21:50:10 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:50:10 user nova-compute[71364]:     <system>
Apr 11 21:50:10 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:50:10 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:50:10 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:50:10 user nova-compute[71364]:       <entry name="serial">5ff9bbaf-1a5e-4acd-aca3-d956728312cb</entry>
Apr 11 21:50:10 user nova-compute[71364]:       <entry name="uuid">5ff9bbaf-1a5e-4acd-aca3-d956728312cb</entry>
Apr 11 21:50:10 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:50:10 user nova-compute[71364]:     </system>
Apr 11 21:50:10 user nova-compute[71364]:   </sysinfo>
Apr 11 21:50:10 user nova-compute[71364]:   <os>
Apr 11 21:50:10 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:50:10 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:50:10 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:50:10 user nova-compute[71364]:   </os>
Apr 11 21:50:10 user nova-compute[71364]:   <features>
Apr 11 21:50:10 user nova-compute[71364]:     <acpi/>
Apr 11 21:50:10 user nova-compute[71364]:     <apic/>
Apr 11 21:50:10 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:50:10 user nova-compute[71364]:   </features>
Apr 11 21:50:10 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:50:10 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:50:10 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:50:10 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:50:10 user nova-compute[71364]:   </clock>
Apr 11 21:50:10 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:50:10 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:50:10 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:50:10 user nova-compute[71364]:   </cpu>
Apr 11 21:50:10 user nova-compute[71364]:   <devices>
Apr 11 21:50:10 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:50:10 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:50:10 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk"/>
Apr 11 21:50:10 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:50:10 user nova-compute[71364]:     </disk>
Apr 11 21:50:10 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:50:10 user nova-compute[71364]:       <mac address="fa:16:3e:44:2c:d8"/>
Apr 11 21:50:10 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:10 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:50:10 user nova-compute[71364]:       <target dev="tap6144f13d-b4"/>
Apr 11 21:50:10 user nova-compute[71364]:     </interface>
Apr 11 21:50:10 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:50:10 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/console.log" append="off"/>
Apr 11 21:50:10 user nova-compute[71364]:     </serial>
Apr 11 21:50:10 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:50:10 user nova-compute[71364]:     <video>
Apr 11 21:50:10 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:10 user nova-compute[71364]:     </video>
Apr 11 21:50:10 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:50:10 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:50:10 user nova-compute[71364]:     </rng>
Apr 11 21:50:10 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:50:10 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:50:10 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:50:10 user nova-compute[71364]:     </memballoon>
Apr 11 21:50:10 user nova-compute[71364]:   </devices>
Apr 11 21:50:10 user nova-compute[71364]: </domain>
Apr 11 21:50:10 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842337295',display_name='tempest-ServerActionsTestJSON-server-1842337295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842337295',id=4,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-c34k408a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=5ff9bbaf-1a5e-4acd-aca3-d956728312cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG os_vif [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6144f13d-b4, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6144f13d-b4, col_values=(('external_ids', {'iface-id': '6144f13d-b463-46ef-b75b-d2d982198b72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:2c:d8', 'vm-uuid': '5ff9bbaf-1a5e-4acd-aca3-d956728312cb'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:10 user nova-compute[71364]: INFO os_vif [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4')
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No VIF found with MAC fa:16:3e:44:2c:d8, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249810.7444816, 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:10 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] VM Resumed (Lifecycle Event)
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:50:10 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Instance spawned successfully.
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:10 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249810.7458396, 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:10 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] VM Started (Lifecycle Event)
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:10 user nova-compute[71364]: INFO nova.compute.manager [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Took 12.55 seconds to spawn the instance on the hypervisor.
Apr 11 21:50:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:10 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Received event network-vif-plugged-f34feb75-3b0a-4198-bdcb-0eaf289e96fb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] Acquiring lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] No waiting events found dispatching network-vif-plugged-f34feb75-3b0a-4198-bdcb-0eaf289e96fb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:11 user nova-compute[71364]: WARNING nova.compute.manager [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Received unexpected event network-vif-plugged-f34feb75-3b0a-4198-bdcb-0eaf289e96fb for instance with vm_state building and task_state spawning.
Apr 11 21:50:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Received event network-vif-plugged-f34feb75-3b0a-4198-bdcb-0eaf289e96fb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] Acquiring lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] No waiting events found dispatching network-vif-plugged-f34feb75-3b0a-4198-bdcb-0eaf289e96fb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:11 user nova-compute[71364]: WARNING nova.compute.manager [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Received unexpected event network-vif-plugged-f34feb75-3b0a-4198-bdcb-0eaf289e96fb for instance with vm_state building and task_state spawning.
Apr 11 21:50:11 user nova-compute[71364]: INFO nova.compute.manager [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Took 13.41 seconds to build instance.
Apr 11 21:50:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.633s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:12 user nova-compute[71364]: DEBUG nova.compute.manager [req-2af093d1-738f-4797-92b9-397e9f852873 req-1c1c8ce1-0afc-4f75-9d19-2d84649c70ce service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Received event network-vif-plugged-9e4da68e-e9a4-4d29-b326-bc52cad55a93 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2af093d1-738f-4797-92b9-397e9f852873 req-1c1c8ce1-0afc-4f75-9d19-2d84649c70ce service nova] Acquiring lock "13124f93-665b-4107-bd71-16674bdb9a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2af093d1-738f-4797-92b9-397e9f852873 req-1c1c8ce1-0afc-4f75-9d19-2d84649c70ce service nova] Lock "13124f93-665b-4107-bd71-16674bdb9a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2af093d1-738f-4797-92b9-397e9f852873 req-1c1c8ce1-0afc-4f75-9d19-2d84649c70ce service nova] Lock "13124f93-665b-4107-bd71-16674bdb9a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:12 user nova-compute[71364]: DEBUG nova.compute.manager [req-2af093d1-738f-4797-92b9-397e9f852873 req-1c1c8ce1-0afc-4f75-9d19-2d84649c70ce service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] No waiting events found dispatching network-vif-plugged-9e4da68e-e9a4-4d29-b326-bc52cad55a93 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:12 user nova-compute[71364]: WARNING nova.compute.manager [req-2af093d1-738f-4797-92b9-397e9f852873 req-1c1c8ce1-0afc-4f75-9d19-2d84649c70ce service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Received unexpected event network-vif-plugged-9e4da68e-e9a4-4d29-b326-bc52cad55a93 for instance with vm_state building and task_state spawning.
Apr 11 21:50:12 user nova-compute[71364]: DEBUG nova.network.neutron [req-7df2e8a9-40c0-4e05-b3ba-6db97edd8a8e req-b0b0cc95-9b35-4916-add4-f9515cf1b524 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updated VIF entry in instance network info cache for port 20b9e448-55b1-49a6-8c39-08b2ab9755eb. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:50:12 user nova-compute[71364]: DEBUG nova.network.neutron [req-7df2e8a9-40c0-4e05-b3ba-6db97edd8a8e req-b0b0cc95-9b35-4916-add4-f9515cf1b524 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updating instance_info_cache with network_info: [{"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7df2e8a9-40c0-4e05-b3ba-6db97edd8a8e req-b0b0cc95-9b35-4916-add4-f9515cf1b524 service nova] Releasing lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:12 user nova-compute[71364]: DEBUG nova.network.neutron [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updated VIF entry in instance network info cache for port 6144f13d-b463-46ef-b75b-d2d982198b72. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:50:12 user nova-compute[71364]: DEBUG nova.network.neutron [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating instance_info_cache with network_info: [{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] Releasing lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:14 user nova-compute[71364]: DEBUG nova.compute.manager [req-b56af6c6-1693-48e2-b5e6-9eecb3c8592a req-8910e636-a837-4425-8c2c-9c368ef83529 service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Received event network-vif-plugged-9e4da68e-e9a4-4d29-b326-bc52cad55a93 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b56af6c6-1693-48e2-b5e6-9eecb3c8592a req-8910e636-a837-4425-8c2c-9c368ef83529 service nova] Acquiring lock "13124f93-665b-4107-bd71-16674bdb9a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b56af6c6-1693-48e2-b5e6-9eecb3c8592a req-8910e636-a837-4425-8c2c-9c368ef83529 service nova] Lock "13124f93-665b-4107-bd71-16674bdb9a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b56af6c6-1693-48e2-b5e6-9eecb3c8592a req-8910e636-a837-4425-8c2c-9c368ef83529 service nova] Lock "13124f93-665b-4107-bd71-16674bdb9a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:14 user nova-compute[71364]: DEBUG nova.compute.manager [req-b56af6c6-1693-48e2-b5e6-9eecb3c8592a req-8910e636-a837-4425-8c2c-9c368ef83529 service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] No waiting events found dispatching network-vif-plugged-9e4da68e-e9a4-4d29-b326-bc52cad55a93 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:14 user nova-compute[71364]: WARNING nova.compute.manager [req-b56af6c6-1693-48e2-b5e6-9eecb3c8592a req-8910e636-a837-4425-8c2c-9c368ef83529 service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Received unexpected event network-vif-plugged-9e4da68e-e9a4-4d29-b326-bc52cad55a93 for instance with vm_state building and task_state spawning.
Apr 11 21:50:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:14 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249814.9289947, 13124f93-665b-4107-bd71-16674bdb9a64 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:14 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] VM Resumed (Lifecycle Event)
Apr 11 21:50:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:50:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:50:14 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Instance spawned successfully.
Apr 11 21:50:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:15 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249814.9405143, 13124f93-665b-4107-bd71-16674bdb9a64 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:15 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] VM Started (Lifecycle Event)
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:15 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:15 user nova-compute[71364]: INFO nova.compute.manager [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Took 14.35 seconds to spawn the instance on the hypervisor.
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:15 user nova-compute[71364]: INFO nova.compute.manager [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Took 15.11 seconds to build instance.
Apr 11 21:50:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "13124f93-665b-4107-bd71-16674bdb9a64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.251s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-3e4875d6-dfa0-40b9-b4ee-eefbb5a55357 req-22e5007c-877e-4e55-98cf-0515620f24f3 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3e4875d6-dfa0-40b9-b4ee-eefbb5a55357 req-22e5007c-877e-4e55-98cf-0515620f24f3 service nova] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3e4875d6-dfa0-40b9-b4ee-eefbb5a55357 req-22e5007c-877e-4e55-98cf-0515620f24f3 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3e4875d6-dfa0-40b9-b4ee-eefbb5a55357 req-22e5007c-877e-4e55-98cf-0515620f24f3 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-3e4875d6-dfa0-40b9-b4ee-eefbb5a55357 req-22e5007c-877e-4e55-98cf-0515620f24f3 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] No waiting events found dispatching network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:15 user nova-compute[71364]: WARNING nova.compute.manager [req-3e4875d6-dfa0-40b9-b4ee-eefbb5a55357 req-22e5007c-877e-4e55-98cf-0515620f24f3 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received unexpected event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance with vm_state building and task_state spawning.
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249815.9830885, e627de16-3a8f-4510-8001-0e57a272b859 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:15 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] VM Resumed (Lifecycle Event)
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:50:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:50:16 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Instance spawned successfully.
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:50:16 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance spawned successfully.
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:50:16 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249815.986988, e627de16-3a8f-4510-8001-0e57a272b859 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:16 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] VM Started (Lifecycle Event)
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:16 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249816.0833175, 5ff9bbaf-1a5e-4acd-aca3-d956728312cb => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:16 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] VM Resumed (Lifecycle Event)
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:16 user nova-compute[71364]: INFO nova.compute.manager [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Took 12.58 seconds to spawn the instance on the hypervisor.
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:16 user nova-compute[71364]: WARNING nova.compute.manager [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state building and task_state spawning.
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:16 user nova-compute[71364]: WARNING nova.compute.manager [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state building and task_state spawning.
Apr 11 21:50:16 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249816.0918589, 5ff9bbaf-1a5e-4acd-aca3-d956728312cb => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:16 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] VM Started (Lifecycle Event)
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:16 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:16 user nova-compute[71364]: INFO nova.compute.manager [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Took 11.99 seconds to spawn the instance on the hypervisor.
Apr 11 21:50:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:16 user nova-compute[71364]: INFO nova.compute.manager [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Took 13.62 seconds to build instance.
Apr 11 21:50:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "e627de16-3a8f-4510-8001-0e57a272b859" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.788s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:16 user nova-compute[71364]: INFO nova.compute.manager [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Took 13.31 seconds to build instance.
Apr 11 21:50:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.544s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-416dcc0d-baed-460b-9119-bb41d79594cb req-e88c4033-f53d-4316-8712-666f77f9dfa2 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-416dcc0d-baed-460b-9119-bb41d79594cb req-e88c4033-f53d-4316-8712-666f77f9dfa2 service nova] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-416dcc0d-baed-460b-9119-bb41d79594cb req-e88c4033-f53d-4316-8712-666f77f9dfa2 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-416dcc0d-baed-460b-9119-bb41d79594cb req-e88c4033-f53d-4316-8712-666f77f9dfa2 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-416dcc0d-baed-460b-9119-bb41d79594cb req-e88c4033-f53d-4316-8712-666f77f9dfa2 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] No waiting events found dispatching network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:17 user nova-compute[71364]: WARNING nova.compute.manager [req-416dcc0d-baed-460b-9119-bb41d79594cb req-e88c4033-f53d-4316-8712-666f77f9dfa2 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received unexpected event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance with vm_state active and task_state None.
Apr 11 21:50:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:50:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:50:22 user nova-compute[71364]: INFO nova.compute.claims [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Claim successful on node user
Apr 11 21:50:22 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:50:22 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:50:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.913s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:50:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:50:23 user nova-compute[71364]: DEBUG nova.network.neutron [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:50:23 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 11 21:50:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:50:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:50:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:50:23 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Creating image(s)
Apr 11 21:50:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "/opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "/opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "/opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "3bbd032191ffa26007665e7631c27b84b72bc483" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "3bbd032191ffa26007665e7631c27b84b72bc483" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:23 user nova-compute[71364]: DEBUG nova.policy [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9be8bb1eb0654966b5ef7303a65f79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd1e1c38499497f8e19c68ac192664c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:50:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483.part --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483.part --force-share --output=json" returned: 0 in 0.176s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:24 user nova-compute[71364]: DEBUG nova.virt.images [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] dafa0bc1-7a67-4b65-b80f-b61d19a80800 was qcow2, converting to raw {{(pid=71364) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 21:50:24 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 21:50:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483.part /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483.converted {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483.part /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483.converted" returned: 0 in 0.336s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483.converted --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "335d5305-28e6-4766-b0b2-b56848ff8652" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "335d5305-28e6-4766-b0b2-b56848ff8652" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "3bbd032191ffa26007665e7631c27b84b72bc483" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.353s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483 --force-share --output=json" returned: 0 in 0.191s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "3bbd032191ffa26007665e7631c27b84b72bc483" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "3bbd032191ffa26007665e7631c27b84b72bc483" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.010s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:50:25 user nova-compute[71364]: INFO nova.compute.claims [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Claim successful on node user
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483 --force-share --output=json" returned: 0 in 0.259s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483,backing_fmt=raw /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483,backing_fmt=raw /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk 1073741824" returned: 0 in 0.079s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "3bbd032191ffa26007665e7631c27b84b72bc483" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483 --force-share --output=json" returned: 0 in 0.259s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG nova.network.neutron [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Successfully created port: 327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:50:25 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Cannot resize image /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.objects.instance [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lazy-loading 'migration_context' on Instance uuid f279b153-a1c9-46f5-a0c5-4574ab956ba8 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Ensure instance console log exists: /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.876s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:50:26 user nova-compute[71364]: INFO nova.compute.claims [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Claim successful on node user
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:50:26 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "5a3b5455-983c-4c30-b229-8922443af209" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "5a3b5455-983c-4c30-b229-8922443af209" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:50:26 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Creating image(s)
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "/opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "/opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "/opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.169s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.policy [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08dd18a54a074e658d08ca381e0c87ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ba7063a25043fdb16f3e1f0c0c51d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.network.neutron [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Successfully updated port: 327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.261s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "refresh_cache-f279b153-a1c9-46f5-a0c5-4574ab956ba8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquired lock "refresh_cache-f279b153-a1c9-46f5-a0c5-4574ab956ba8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.network.neutron [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:50:26 user nova-compute[71364]: INFO nova.compute.claims [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Claim successful on node user
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.189s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.compute.manager [req-944f956b-e520-4dde-8c7f-a8554983e293 req-606ee226-59c5-40d5-801f-6bbe8dea9c26 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Received event network-changed-327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.compute.manager [req-944f956b-e520-4dde-8c7f-a8554983e293 req-606ee226-59c5-40d5-801f-6bbe8dea9c26 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Refreshing instance network info cache due to event network-changed-327f645b-e31b-4f09-88d2-a53f8a29905c. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-944f956b-e520-4dde-8c7f-a8554983e293 req-606ee226-59c5-40d5-801f-6bbe8dea9c26 service nova] Acquiring lock "refresh_cache-f279b153-a1c9-46f5-a0c5-4574ab956ba8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk 1073741824" returned: 0 in 0.093s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.network.neutron [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:50:27 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.205s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Checking if we can resize image /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.policy [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37879b83a5b74e28bcde8d4885fa4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457b454a52ca4559b8398291e482ba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Cannot resize image /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.objects.instance [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lazy-loading 'migration_context' on Instance uuid 335d5305-28e6-4766-b0b2-b56848ff8652 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:50:27 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Creating image(s)
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "/opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "/opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "/opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Ensure instance console log exists: /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.166s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.879s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.156s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk 1073741824" returned: 0 in 0.068s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.network.neutron [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Updating instance_info_cache with network_info: [{"id": "327f645b-e31b-4f09-88d2-a53f8a29905c", "address": "fa:16:3e:04:64:b5", "network": {"id": "35726c30-f646-4544-9320-15be81152224", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1748990227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fd1e1c38499497f8e19c68ac192664c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap327f645b-e3", "ovs_interfaceid": "327f645b-e31b-4f09-88d2-a53f8a29905c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Releasing lock "refresh_cache-f279b153-a1c9-46f5-a0c5-4574ab956ba8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Instance network_info: |[{"id": "327f645b-e31b-4f09-88d2-a53f8a29905c", "address": "fa:16:3e:04:64:b5", "network": {"id": "35726c30-f646-4544-9320-15be81152224", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1748990227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fd1e1c38499497f8e19c68ac192664c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap327f645b-e3", "ovs_interfaceid": "327f645b-e31b-4f09-88d2-a53f8a29905c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-944f956b-e520-4dde-8c7f-a8554983e293 req-606ee226-59c5-40d5-801f-6bbe8dea9c26 service nova] Acquired lock "refresh_cache-f279b153-a1c9-46f5-a0c5-4574ab956ba8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.network.neutron [req-944f956b-e520-4dde-8c7f-a8554983e293 req-606ee226-59c5-40d5-801f-6bbe8dea9c26 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Refreshing network info cache for port 327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Start _get_guest_xml network_info=[{"id": "327f645b-e31b-4f09-88d2-a53f8a29905c", "address": "fa:16:3e:04:64:b5", "network": {"id": "35726c30-f646-4544-9320-15be81152224", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1748990227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fd1e1c38499497f8e19c68ac192664c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap327f645b-e3", "ovs_interfaceid": "327f645b-e31b-4f09-88d2-a53f8a29905c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:50:13Z,direct_url=<?>,disk_format='qcow2',id=dafa0bc1-7a67-4b65-b80f-b61d19a80800,min_disk=0,min_ram=0,name='',owner='bd87a94ac47846eebe165246a78be941',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:50:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'dafa0bc1-7a67-4b65-b80f-b61d19a80800'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:50:27 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:50:27 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:27 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:50:13Z,direct_url=<?>,disk_format='qcow2',id=dafa0bc1-7a67-4b65-b80f-b61d19a80800,min_disk=0,min_ram=0,name='',owner='bd87a94ac47846eebe165246a78be941',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:50:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1191919716',display_name='tempest-AttachSCSIVolumeTestJSON-server-1191919716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1191919716',id=5,image_ref='dafa0bc1-7a67-4b65-b80f-b61d19a80800',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZmW6Wfm7Cm10lK8Gby/74Xu70dkDdNfKx0+J90JYG69zVAuhB6Iyp4rnIXMAeonPMSjCxz7uGGCE2/d6KUlLjQ25M4KEhzrX4FF+u3bvtEurn5qw7S9e2w1QCl7YvJtQ==',key_name='tempest-keypair-1843059498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fd1e1c38499497f8e19c68ac192664c',ramdisk_id='',reservation_id='r-de4swypx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dafa0bc1-7a67-4b65-b80f-b61d19a80800',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-213208191',owner_user_name='tempest-AttachSCSIVolumeTestJSON-213208191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:50:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9be8bb1eb0654966b5ef7303a65f79df',uuid=f279b153-a1c9-46f5-a0c5-4574ab956ba8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "327f645b-e31b-4f09-88d2-a53f8a29905c", "address": "fa:16:3e:04:64:b5", "network": {"id": "35726c30-f646-4544-9320-15be81152224", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1748990227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fd1e1c38499497f8e19c68ac192664c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap327f645b-e3", "ovs_interfaceid": "327f645b-e31b-4f09-88d2-a53f8a29905c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Converting VIF {"id": "327f645b-e31b-4f09-88d2-a53f8a29905c", "address": "fa:16:3e:04:64:b5", "network": {"id": "35726c30-f646-4544-9320-15be81152224", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1748990227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fd1e1c38499497f8e19c68ac192664c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap327f645b-e3", "ovs_interfaceid": "327f645b-e31b-4f09-88d2-a53f8a29905c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:64:b5,bridge_name='br-int',has_traffic_filtering=True,id=327f645b-e31b-4f09-88d2-a53f8a29905c,network=Network(35726c30-f646-4544-9320-15be81152224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap327f645b-e3') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.objects.instance [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lazy-loading 'pci_devices' on Instance uuid f279b153-a1c9-46f5-a0c5-4574ab956ba8 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.199s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:50:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:50:28 user nova-compute[71364]:   <uuid>f279b153-a1c9-46f5-a0c5-4574ab956ba8</uuid>
Apr 11 21:50:28 user nova-compute[71364]:   <name>instance-00000005</name>
Apr 11 21:50:28 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:50:28 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:50:28 user nova-compute[71364]:   <metadata>
Apr 11 21:50:28 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:50:28 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:50:28 user nova-compute[71364]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1191919716</nova:name>
Apr 11 21:50:28 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:50:27</nova:creationTime>
Apr 11 21:50:28 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:50:28 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:50:28 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:50:28 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:50:28 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:50:28 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:50:28 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:50:28 user nova-compute[71364]:       <nova:owner>
Apr 11 21:50:28 user nova-compute[71364]:         <nova:user uuid="9be8bb1eb0654966b5ef7303a65f79df">tempest-AttachSCSIVolumeTestJSON-213208191-project-member</nova:user>
Apr 11 21:50:28 user nova-compute[71364]:         <nova:project uuid="1fd1e1c38499497f8e19c68ac192664c">tempest-AttachSCSIVolumeTestJSON-213208191</nova:project>
Apr 11 21:50:28 user nova-compute[71364]:       </nova:owner>
Apr 11 21:50:28 user nova-compute[71364]:       <nova:root type="image" uuid="dafa0bc1-7a67-4b65-b80f-b61d19a80800"/>
Apr 11 21:50:28 user nova-compute[71364]:       <nova:ports>
Apr 11 21:50:28 user nova-compute[71364]:         <nova:port uuid="327f645b-e31b-4f09-88d2-a53f8a29905c">
Apr 11 21:50:28 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 21:50:28 user nova-compute[71364]:         </nova:port>
Apr 11 21:50:28 user nova-compute[71364]:       </nova:ports>
Apr 11 21:50:28 user nova-compute[71364]:     </nova:instance>
Apr 11 21:50:28 user nova-compute[71364]:   </metadata>
Apr 11 21:50:28 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:50:28 user nova-compute[71364]:     <system>
Apr 11 21:50:28 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:50:28 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:50:28 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:50:28 user nova-compute[71364]:       <entry name="serial">f279b153-a1c9-46f5-a0c5-4574ab956ba8</entry>
Apr 11 21:50:28 user nova-compute[71364]:       <entry name="uuid">f279b153-a1c9-46f5-a0c5-4574ab956ba8</entry>
Apr 11 21:50:28 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:50:28 user nova-compute[71364]:     </system>
Apr 11 21:50:28 user nova-compute[71364]:   </sysinfo>
Apr 11 21:50:28 user nova-compute[71364]:   <os>
Apr 11 21:50:28 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:50:28 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:50:28 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:50:28 user nova-compute[71364]:   </os>
Apr 11 21:50:28 user nova-compute[71364]:   <features>
Apr 11 21:50:28 user nova-compute[71364]:     <acpi/>
Apr 11 21:50:28 user nova-compute[71364]:     <apic/>
Apr 11 21:50:28 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:50:28 user nova-compute[71364]:   </features>
Apr 11 21:50:28 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:50:28 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:50:28 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:50:28 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:50:28 user nova-compute[71364]:   </clock>
Apr 11 21:50:28 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:50:28 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:50:28 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:50:28 user nova-compute[71364]:   </cpu>
Apr 11 21:50:28 user nova-compute[71364]:   <devices>
Apr 11 21:50:28 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:50:28 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:50:28 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk"/>
Apr 11 21:50:28 user nova-compute[71364]:       <target dev="sda" bus="scsi"/>
Apr 11 21:50:28 user nova-compute[71364]:       <address type="drive" controller="0" unit="0"/>
Apr 11 21:50:28 user nova-compute[71364]:     </disk>
Apr 11 21:50:28 user nova-compute[71364]:     <disk type="file" device="cdrom">
Apr 11 21:50:28 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 21:50:28 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk.config"/>
Apr 11 21:50:28 user nova-compute[71364]:       <target dev="sdb" bus="scsi"/>
Apr 11 21:50:28 user nova-compute[71364]:       <address type="drive" controller="0" unit="1"/>
Apr 11 21:50:28 user nova-compute[71364]:     </disk>
Apr 11 21:50:28 user nova-compute[71364]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 11 21:50:28 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:50:28 user nova-compute[71364]:       <mac address="fa:16:3e:04:64:b5"/>
Apr 11 21:50:28 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:28 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:50:28 user nova-compute[71364]:       <target dev="tap327f645b-e3"/>
Apr 11 21:50:28 user nova-compute[71364]:     </interface>
Apr 11 21:50:28 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:50:28 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/console.log" append="off"/>
Apr 11 21:50:28 user nova-compute[71364]:     </serial>
Apr 11 21:50:28 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:50:28 user nova-compute[71364]:     <video>
Apr 11 21:50:28 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:28 user nova-compute[71364]:     </video>
Apr 11 21:50:28 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:50:28 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:50:28 user nova-compute[71364]:     </rng>
Apr 11 21:50:28 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:50:28 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:50:28 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:50:28 user nova-compute[71364]:     </memballoon>
Apr 11 21:50:28 user nova-compute[71364]:   </devices>
Apr 11 21:50:28 user nova-compute[71364]: </domain>
Apr 11 21:50:28 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1191919716',display_name='tempest-AttachSCSIVolumeTestJSON-server-1191919716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1191919716',id=5,image_ref='dafa0bc1-7a67-4b65-b80f-b61d19a80800',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZmW6Wfm7Cm10lK8Gby/74Xu70dkDdNfKx0+J90JYG69zVAuhB6Iyp4rnIXMAeonPMSjCxz7uGGCE2/d6KUlLjQ25M4KEhzrX4FF+u3bvtEurn5qw7S9e2w1QCl7YvJtQ==',key_name='tempest-keypair-1843059498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fd1e1c38499497f8e19c68ac192664c',ramdisk_id='',reservation_id='r-de4swypx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dafa0bc1-7a67-4b65-b80f-b61d19a80800',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-213208191',owner_user_name='tempest-AttachSCSIVolumeTestJSON-213208191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:50:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9be8bb1eb0654966b5ef7303a65f79df',uuid=f279b153-a1c9-46f5-a0c5-4574ab956ba8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "327f645b-e31b-4f09-88d2-a53f8a29905c", "address": "fa:16:3e:04:64:b5", "network": {"id": "35726c30-f646-4544-9320-15be81152224", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1748990227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fd1e1c38499497f8e19c68ac192664c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap327f645b-e3", "ovs_interfaceid": "327f645b-e31b-4f09-88d2-a53f8a29905c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Converting VIF {"id": "327f645b-e31b-4f09-88d2-a53f8a29905c", "address": "fa:16:3e:04:64:b5", "network": {"id": "35726c30-f646-4544-9320-15be81152224", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1748990227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fd1e1c38499497f8e19c68ac192664c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap327f645b-e3", "ovs_interfaceid": "327f645b-e31b-4f09-88d2-a53f8a29905c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:64:b5,bridge_name='br-int',has_traffic_filtering=True,id=327f645b-e31b-4f09-88d2-a53f8a29905c,network=Network(35726c30-f646-4544-9320-15be81152224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap327f645b-e3') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG os_vif [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:64:b5,bridge_name='br-int',has_traffic_filtering=True,id=327f645b-e31b-4f09-88d2-a53f8a29905c,network=Network(35726c30-f646-4544-9320-15be81152224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap327f645b-e3') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.policy [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33f11dee7865404b9271be236429db1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1a9b6214384320b7d75e890e569b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap327f645b-e3, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap327f645b-e3, col_values=(('external_ids', {'iface-id': '327f645b-e31b-4f09-88d2-a53f8a29905c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:64:b5', 'vm-uuid': 'f279b153-a1c9-46f5-a0c5-4574ab956ba8'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:28 user nova-compute[71364]: INFO os_vif [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:64:b5,bridge_name='br-int',has_traffic_filtering=True,id=327f645b-e31b-4f09-88d2-a53f8a29905c,network=Network(35726c30-f646-4544-9320-15be81152224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap327f645b-e3')
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:50:28 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Creating image(s)
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "/opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "/opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Cannot resize image /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lazy-loading 'migration_context' on Instance uuid 71a04a77-49b8-4d4a-bc66-e233aa7eab08 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Ensure instance console log exists: /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] No BDM found with device name sda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] No VIF found with MAC fa:16:3e:04:64:b5, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:50:28 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Using config drive
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.176s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Successfully created port: 2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Successfully created port: 875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.177s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk 1073741824" returned: 0 in 0.078s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:28 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Creating config drive at /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk.config
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3vyto5ss {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3vyto5ss" returned: 0 in 0.082s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.158s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:50:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Successfully created port: 70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Cannot resize image /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.objects.instance [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lazy-loading 'migration_context' on Instance uuid 5a3b5455-983c-4c30-b229-8922443af209 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Ensure instance console log exists: /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.network.neutron [req-944f956b-e520-4dde-8c7f-a8554983e293 req-606ee226-59c5-40d5-801f-6bbe8dea9c26 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Updated VIF entry in instance network info cache for port 327f645b-e31b-4f09-88d2-a53f8a29905c. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.network.neutron [req-944f956b-e520-4dde-8c7f-a8554983e293 req-606ee226-59c5-40d5-801f-6bbe8dea9c26 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Updating instance_info_cache with network_info: [{"id": "327f645b-e31b-4f09-88d2-a53f8a29905c", "address": "fa:16:3e:04:64:b5", "network": {"id": "35726c30-f646-4544-9320-15be81152224", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1748990227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fd1e1c38499497f8e19c68ac192664c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap327f645b-e3", "ovs_interfaceid": "327f645b-e31b-4f09-88d2-a53f8a29905c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-944f956b-e520-4dde-8c7f-a8554983e293 req-606ee226-59c5-40d5-801f-6bbe8dea9c26 service nova] Releasing lock "refresh_cache-f279b153-a1c9-46f5-a0c5-4574ab956ba8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Successfully updated port: 875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquired lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Successfully updated port: 2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "refresh_cache-71a04a77-49b8-4d4a-bc66-e233aa7eab08" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquired lock "refresh_cache-71a04a77-49b8-4d4a-bc66-e233aa7eab08" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-b8687e10-24f4-42db-854f-e3d361219411 req-75dc0a70-6a6f-4064-996b-bec19dd83644 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received event network-changed-875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-b8687e10-24f4-42db-854f-e3d361219411 req-75dc0a70-6a6f-4064-996b-bec19dd83644 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Refreshing instance network info cache due to event network-changed-875f44f1-120e-48bc-9742-662c6bb93332. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b8687e10-24f4-42db-854f-e3d361219411 req-75dc0a70-6a6f-4064-996b-bec19dd83644 service nova] Acquiring lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-0381f12a-b0cc-4780-9a8a-6aa5a9300527 req-66e7069c-3343-485d-ad2e-0a209239f147 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Received event network-changed-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-0381f12a-b0cc-4780-9a8a-6aa5a9300527 req-66e7069c-3343-485d-ad2e-0a209239f147 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Refreshing instance network info cache due to event network-changed-2bf7ba51-4360-45c5-bada-6d7113ca3aa5. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0381f12a-b0cc-4780-9a8a-6aa5a9300527 req-66e7069c-3343-485d-ad2e-0a209239f147 service nova] Acquiring lock "refresh_cache-71a04a77-49b8-4d4a-bc66-e233aa7eab08" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:29 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Successfully updated port: 70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-f1c28cd5-7d67-4a05-ad3d-f05dd11e0d7d req-c93d5363-0b60-40cb-803a-1f28f95c51a6 service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Received event network-changed-70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-f1c28cd5-7d67-4a05-ad3d-f05dd11e0d7d req-c93d5363-0b60-40cb-803a-1f28f95c51a6 service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Refreshing instance network info cache due to event network-changed-70618f68-d426-45e0-aa51-0bffb5b512f5. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f1c28cd5-7d67-4a05-ad3d-f05dd11e0d7d req-c93d5363-0b60-40cb-803a-1f28f95c51a6 service nova] Acquiring lock "refresh_cache-5a3b5455-983c-4c30-b229-8922443af209" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f1c28cd5-7d67-4a05-ad3d-f05dd11e0d7d req-c93d5363-0b60-40cb-803a-1f28f95c51a6 service nova] Acquired lock "refresh_cache-5a3b5455-983c-4c30-b229-8922443af209" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.neutron [req-f1c28cd5-7d67-4a05-ad3d-f05dd11e0d7d req-c93d5363-0b60-40cb-803a-1f28f95c51a6 service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Refreshing network info cache for port 70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "refresh_cache-5a3b5455-983c-4c30-b229-8922443af209" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.neutron [req-f1c28cd5-7d67-4a05-ad3d-f05dd11e0d7d req-c93d5363-0b60-40cb-803a-1f28f95c51a6 service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Updating instance_info_cache with network_info: [{"id": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "address": "fa:16:3e:c2:69:1f", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7ba51-43", "ovs_interfaceid": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Releasing lock "refresh_cache-71a04a77-49b8-4d4a-bc66-e233aa7eab08" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Instance network_info: |[{"id": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "address": "fa:16:3e:c2:69:1f", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7ba51-43", "ovs_interfaceid": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0381f12a-b0cc-4780-9a8a-6aa5a9300527 req-66e7069c-3343-485d-ad2e-0a209239f147 service nova] Acquired lock "refresh_cache-71a04a77-49b8-4d4a-bc66-e233aa7eab08" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.neutron [req-0381f12a-b0cc-4780-9a8a-6aa5a9300527 req-66e7069c-3343-485d-ad2e-0a209239f147 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Refreshing network info cache for port 2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Start _get_guest_xml network_info=[{"id": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "address": "fa:16:3e:c2:69:1f", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7ba51-43", "ovs_interfaceid": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Updating instance_info_cache with network_info: [{"id": "875f44f1-120e-48bc-9742-662c6bb93332", "address": "fa:16:3e:27:80:f5", "network": {"id": "35eb0a23-469f-4f8a-8c16-1cea8207fd79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1614521033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875f44f1-12", "ovs_interfaceid": "875f44f1-120e-48bc-9742-662c6bb93332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Releasing lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Instance network_info: |[{"id": "875f44f1-120e-48bc-9742-662c6bb93332", "address": "fa:16:3e:27:80:f5", "network": {"id": "35eb0a23-469f-4f8a-8c16-1cea8207fd79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1614521033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875f44f1-12", "ovs_interfaceid": "875f44f1-120e-48bc-9742-662c6bb93332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b8687e10-24f4-42db-854f-e3d361219411 req-75dc0a70-6a6f-4064-996b-bec19dd83644 service nova] Acquired lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.neutron [req-b8687e10-24f4-42db-854f-e3d361219411 req-75dc0a70-6a6f-4064-996b-bec19dd83644 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Refreshing network info cache for port 875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Start _get_guest_xml network_info=[{"id": "875f44f1-120e-48bc-9742-662c6bb93332", "address": "fa:16:3e:27:80:f5", "network": {"id": "35eb0a23-469f-4f8a-8c16-1cea8207fd79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1614521033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875f44f1-12", "ovs_interfaceid": "875f44f1-120e-48bc-9742-662c6bb93332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:50:30 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:30 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1562113130',display_name='tempest-VolumesAdminNegativeTest-server-1562113130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1562113130',id=7,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRDQbClyWjaWVMh/dFS8MH10Zkv2DPV56TNsv7KqLPCcSdaXoJ9t+c79OwigEZhCLe+pIkQkR/X3KHrwaqVQOn3MrgLwKyHSIl0SfrEul3klmry4bD1s8GoQO+cmcZXvA==',key_name='tempest-keypair-327855003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457b454a52ca4559b8398291e482ba70',ramdisk_id='',reservation_id='r-glmyvjy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1674781287',owner_user_name='tempest-VolumesAdminNegativeTest-1674781287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:50:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37879b83a5b74e28bcde8d4885fa4ccc',uuid=71a04a77-49b8-4d4a-bc66-e233aa7eab08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "address": "fa:16:3e:c2:69:1f", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7ba51-43", "ovs_interfaceid": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Converting VIF {"id": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "address": "fa:16:3e:c2:69:1f", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7ba51-43", "ovs_interfaceid": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:69:1f,bridge_name='br-int',has_traffic_filtering=True,id=2bf7ba51-4360-45c5-bada-6d7113ca3aa5,network=Network(61f0f827-13c4-4f31-9a58-c653a4b3a778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf7ba51-43') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lazy-loading 'pci_devices' on Instance uuid 71a04a77-49b8-4d4a-bc66-e233aa7eab08 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:30 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:30 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-221002458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-221002458',id=6,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9SP67fRzYDr8pH3V24PAo6C5dZmRotW5QhNbjR+STaXowwhPQJNMYnIBrtgPE8JNDkIhvyxuwrwGRJsSpYFrzFZJJ9OejIdMCTzPDQ0PbvVC018NQN2jkSZDBN+Zyluw==',key_name='tempest-keypair-156975459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2ba7063a25043fdb16f3e1f0c0c51d3',ramdisk_id='',reservation_id='r-0l47ba19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2065530295',owner_user_name='tempest-TaggedAttachmentsTest-2065530295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:50:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08dd18a54a074e658d08ca381e0c87ff',uuid=335d5305-28e6-4766-b0b2-b56848ff8652,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "875f44f1-120e-48bc-9742-662c6bb93332", "address": "fa:16:3e:27:80:f5", "network": {"id": "35eb0a23-469f-4f8a-8c16-1cea8207fd79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1614521033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875f44f1-12", "ovs_interfaceid": "875f44f1-120e-48bc-9742-662c6bb93332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Converting VIF {"id": "875f44f1-120e-48bc-9742-662c6bb93332", "address": "fa:16:3e:27:80:f5", "network": {"id": "35eb0a23-469f-4f8a-8c16-1cea8207fd79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1614521033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875f44f1-12", "ovs_interfaceid": "875f44f1-120e-48bc-9742-662c6bb93332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:80:f5,bridge_name='br-int',has_traffic_filtering=True,id=875f44f1-120e-48bc-9742-662c6bb93332,network=Network(35eb0a23-469f-4f8a-8c16-1cea8207fd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875f44f1-12') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.objects.instance [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lazy-loading 'pci_devices' on Instance uuid 335d5305-28e6-4766-b0b2-b56848ff8652 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:50:30 user nova-compute[71364]:   <uuid>71a04a77-49b8-4d4a-bc66-e233aa7eab08</uuid>
Apr 11 21:50:30 user nova-compute[71364]:   <name>instance-00000007</name>
Apr 11 21:50:30 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:50:30 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:50:30 user nova-compute[71364]:   <metadata>
Apr 11 21:50:30 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:50:30 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:50:30 user nova-compute[71364]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1562113130</nova:name>
Apr 11 21:50:30 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:50:30</nova:creationTime>
Apr 11 21:50:30 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:50:30 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:50:30 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:50:30 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:50:30 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:50:30 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:50:30 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:50:30 user nova-compute[71364]:       <nova:owner>
Apr 11 21:50:30 user nova-compute[71364]:         <nova:user uuid="37879b83a5b74e28bcde8d4885fa4ccc">tempest-VolumesAdminNegativeTest-1674781287-project-member</nova:user>
Apr 11 21:50:30 user nova-compute[71364]:         <nova:project uuid="457b454a52ca4559b8398291e482ba70">tempest-VolumesAdminNegativeTest-1674781287</nova:project>
Apr 11 21:50:30 user nova-compute[71364]:       </nova:owner>
Apr 11 21:50:30 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:50:30 user nova-compute[71364]:       <nova:ports>
Apr 11 21:50:30 user nova-compute[71364]:         <nova:port uuid="2bf7ba51-4360-45c5-bada-6d7113ca3aa5">
Apr 11 21:50:30 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 21:50:30 user nova-compute[71364]:         </nova:port>
Apr 11 21:50:30 user nova-compute[71364]:       </nova:ports>
Apr 11 21:50:30 user nova-compute[71364]:     </nova:instance>
Apr 11 21:50:30 user nova-compute[71364]:   </metadata>
Apr 11 21:50:30 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:50:30 user nova-compute[71364]:     <system>
Apr 11 21:50:30 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:50:30 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:50:30 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:50:30 user nova-compute[71364]:       <entry name="serial">71a04a77-49b8-4d4a-bc66-e233aa7eab08</entry>
Apr 11 21:50:30 user nova-compute[71364]:       <entry name="uuid">71a04a77-49b8-4d4a-bc66-e233aa7eab08</entry>
Apr 11 21:50:30 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:50:30 user nova-compute[71364]:     </system>
Apr 11 21:50:30 user nova-compute[71364]:   </sysinfo>
Apr 11 21:50:30 user nova-compute[71364]:   <os>
Apr 11 21:50:30 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:50:30 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:50:30 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:50:30 user nova-compute[71364]:   </os>
Apr 11 21:50:30 user nova-compute[71364]:   <features>
Apr 11 21:50:30 user nova-compute[71364]:     <acpi/>
Apr 11 21:50:30 user nova-compute[71364]:     <apic/>
Apr 11 21:50:30 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:50:30 user nova-compute[71364]:   </features>
Apr 11 21:50:30 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:50:30 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:50:30 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:50:30 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:50:30 user nova-compute[71364]:   </clock>
Apr 11 21:50:30 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:50:30 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:50:30 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:50:30 user nova-compute[71364]:   </cpu>
Apr 11 21:50:30 user nova-compute[71364]:   <devices>
Apr 11 21:50:30 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:50:30 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:50:30 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk"/>
Apr 11 21:50:30 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:50:30 user nova-compute[71364]:     </disk>
Apr 11 21:50:30 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:50:30 user nova-compute[71364]:       <mac address="fa:16:3e:c2:69:1f"/>
Apr 11 21:50:30 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:30 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:50:30 user nova-compute[71364]:       <target dev="tap2bf7ba51-43"/>
Apr 11 21:50:30 user nova-compute[71364]:     </interface>
Apr 11 21:50:30 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:50:30 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/console.log" append="off"/>
Apr 11 21:50:30 user nova-compute[71364]:     </serial>
Apr 11 21:50:30 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:50:30 user nova-compute[71364]:     <video>
Apr 11 21:50:30 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:30 user nova-compute[71364]:     </video>
Apr 11 21:50:30 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:50:30 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:50:30 user nova-compute[71364]:     </rng>
Apr 11 21:50:30 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:50:30 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:50:30 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:50:30 user nova-compute[71364]:     </memballoon>
Apr 11 21:50:30 user nova-compute[71364]:   </devices>
Apr 11 21:50:30 user nova-compute[71364]: </domain>
Apr 11 21:50:30 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1562113130',display_name='tempest-VolumesAdminNegativeTest-server-1562113130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1562113130',id=7,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRDQbClyWjaWVMh/dFS8MH10Zkv2DPV56TNsv7KqLPCcSdaXoJ9t+c79OwigEZhCLe+pIkQkR/X3KHrwaqVQOn3MrgLwKyHSIl0SfrEul3klmry4bD1s8GoQO+cmcZXvA==',key_name='tempest-keypair-327855003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457b454a52ca4559b8398291e482ba70',ramdisk_id='',reservation_id='r-glmyvjy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1674781287',owner_user_name='tempest-VolumesAdminNegativeTest-1674781287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:50:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37879b83a5b74e28bcde8d4885fa4ccc',uuid=71a04a77-49b8-4d4a-bc66-e233aa7eab08,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "address": "fa:16:3e:c2:69:1f", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7ba51-43", "ovs_interfaceid": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Converting VIF {"id": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "address": "fa:16:3e:c2:69:1f", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7ba51-43", "ovs_interfaceid": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:69:1f,bridge_name='br-int',has_traffic_filtering=True,id=2bf7ba51-4360-45c5-bada-6d7113ca3aa5,network=Network(61f0f827-13c4-4f31-9a58-c653a4b3a778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf7ba51-43') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG os_vif [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:69:1f,bridge_name='br-int',has_traffic_filtering=True,id=2bf7ba51-4360-45c5-bada-6d7113ca3aa5,network=Network(61f0f827-13c4-4f31-9a58-c653a4b3a778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf7ba51-43') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:50:30 user nova-compute[71364]:   <uuid>335d5305-28e6-4766-b0b2-b56848ff8652</uuid>
Apr 11 21:50:30 user nova-compute[71364]:   <name>instance-00000006</name>
Apr 11 21:50:30 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:50:30 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:50:30 user nova-compute[71364]:   <metadata>
Apr 11 21:50:30 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:50:30 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:50:30 user nova-compute[71364]:       <nova:name>tempest-device-tagging-server-221002458</nova:name>
Apr 11 21:50:30 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:50:30</nova:creationTime>
Apr 11 21:50:30 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:50:30 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:50:30 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:50:30 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:50:30 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:50:30 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:50:30 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:50:30 user nova-compute[71364]:       <nova:owner>
Apr 11 21:50:30 user nova-compute[71364]:         <nova:user uuid="08dd18a54a074e658d08ca381e0c87ff">tempest-TaggedAttachmentsTest-2065530295-project-member</nova:user>
Apr 11 21:50:30 user nova-compute[71364]:         <nova:project uuid="c2ba7063a25043fdb16f3e1f0c0c51d3">tempest-TaggedAttachmentsTest-2065530295</nova:project>
Apr 11 21:50:30 user nova-compute[71364]:       </nova:owner>
Apr 11 21:50:30 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:50:30 user nova-compute[71364]:       <nova:ports>
Apr 11 21:50:30 user nova-compute[71364]:         <nova:port uuid="875f44f1-120e-48bc-9742-662c6bb93332">
Apr 11 21:50:30 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 21:50:30 user nova-compute[71364]:         </nova:port>
Apr 11 21:50:30 user nova-compute[71364]:       </nova:ports>
Apr 11 21:50:30 user nova-compute[71364]:     </nova:instance>
Apr 11 21:50:30 user nova-compute[71364]:   </metadata>
Apr 11 21:50:30 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:50:30 user nova-compute[71364]:     <system>
Apr 11 21:50:30 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:50:30 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:50:30 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:50:30 user nova-compute[71364]:       <entry name="serial">335d5305-28e6-4766-b0b2-b56848ff8652</entry>
Apr 11 21:50:30 user nova-compute[71364]:       <entry name="uuid">335d5305-28e6-4766-b0b2-b56848ff8652</entry>
Apr 11 21:50:30 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:50:30 user nova-compute[71364]:     </system>
Apr 11 21:50:30 user nova-compute[71364]:   </sysinfo>
Apr 11 21:50:30 user nova-compute[71364]:   <os>
Apr 11 21:50:30 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:50:30 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:50:30 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:50:30 user nova-compute[71364]:   </os>
Apr 11 21:50:30 user nova-compute[71364]:   <features>
Apr 11 21:50:30 user nova-compute[71364]:     <acpi/>
Apr 11 21:50:30 user nova-compute[71364]:     <apic/>
Apr 11 21:50:30 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:50:30 user nova-compute[71364]:   </features>
Apr 11 21:50:30 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:50:30 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:50:30 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:50:30 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:50:30 user nova-compute[71364]:   </clock>
Apr 11 21:50:30 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:50:30 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:50:30 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:50:30 user nova-compute[71364]:   </cpu>
Apr 11 21:50:30 user nova-compute[71364]:   <devices>
Apr 11 21:50:30 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:50:30 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:50:30 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk"/>
Apr 11 21:50:30 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:50:30 user nova-compute[71364]:     </disk>
Apr 11 21:50:30 user nova-compute[71364]:     <disk type="file" device="cdrom">
Apr 11 21:50:30 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 21:50:30 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk.config"/>
Apr 11 21:50:30 user nova-compute[71364]:       <target dev="hda" bus="ide"/>
Apr 11 21:50:30 user nova-compute[71364]:     </disk>
Apr 11 21:50:30 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:50:30 user nova-compute[71364]:       <mac address="fa:16:3e:27:80:f5"/>
Apr 11 21:50:30 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:30 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:50:30 user nova-compute[71364]:       <target dev="tap875f44f1-12"/>
Apr 11 21:50:30 user nova-compute[71364]:     </interface>
Apr 11 21:50:30 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:50:30 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/console.log" append="off"/>
Apr 11 21:50:30 user nova-compute[71364]:     </serial>
Apr 11 21:50:30 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:50:30 user nova-compute[71364]:     <video>
Apr 11 21:50:30 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:30 user nova-compute[71364]:     </video>
Apr 11 21:50:30 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:50:30 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:50:30 user nova-compute[71364]:     </rng>
Apr 11 21:50:30 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:50:30 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:50:30 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:50:30 user nova-compute[71364]:     </memballoon>
Apr 11 21:50:30 user nova-compute[71364]:   </devices>
Apr 11 21:50:30 user nova-compute[71364]: </domain>
Apr 11 21:50:30 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-221002458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-221002458',id=6,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9SP67fRzYDr8pH3V24PAo6C5dZmRotW5QhNbjR+STaXowwhPQJNMYnIBrtgPE8JNDkIhvyxuwrwGRJsSpYFrzFZJJ9OejIdMCTzPDQ0PbvVC018NQN2jkSZDBN+Zyluw==',key_name='tempest-keypair-156975459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2ba7063a25043fdb16f3e1f0c0c51d3',ramdisk_id='',reservation_id='r-0l47ba19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2065530295',owner_user_name='tempest-TaggedAttachmentsTest-2065530295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:50:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08dd18a54a074e658d08ca381e0c87ff',uuid=335d5305-28e6-4766-b0b2-b56848ff8652,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "875f44f1-120e-48bc-9742-662c6bb93332", "address": "fa:16:3e:27:80:f5", "network": {"id": "35eb0a23-469f-4f8a-8c16-1cea8207fd79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1614521033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875f44f1-12", "ovs_interfaceid": "875f44f1-120e-48bc-9742-662c6bb93332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Converting VIF {"id": "875f44f1-120e-48bc-9742-662c6bb93332", "address": "fa:16:3e:27:80:f5", "network": {"id": "35eb0a23-469f-4f8a-8c16-1cea8207fd79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1614521033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875f44f1-12", "ovs_interfaceid": "875f44f1-120e-48bc-9742-662c6bb93332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:80:f5,bridge_name='br-int',has_traffic_filtering=True,id=875f44f1-120e-48bc-9742-662c6bb93332,network=Network(35eb0a23-469f-4f8a-8c16-1cea8207fd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875f44f1-12') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG os_vif [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:80:f5,bridge_name='br-int',has_traffic_filtering=True,id=875f44f1-120e-48bc-9742-662c6bb93332,network=Network(35eb0a23-469f-4f8a-8c16-1cea8207fd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875f44f1-12') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bf7ba51-43, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2bf7ba51-43, col_values=(('external_ids', {'iface-id': '2bf7ba51-4360-45c5-bada-6d7113ca3aa5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:69:1f', 'vm-uuid': '71a04a77-49b8-4d4a-bc66-e233aa7eab08'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:30 user nova-compute[71364]: INFO os_vif [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:69:1f,bridge_name='br-int',has_traffic_filtering=True,id=2bf7ba51-4360-45c5-bada-6d7113ca3aa5,network=Network(61f0f827-13c4-4f31-9a58-c653a4b3a778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf7ba51-43')
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap875f44f1-12, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap875f44f1-12, col_values=(('external_ids', {'iface-id': '875f44f1-120e-48bc-9742-662c6bb93332', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:80:f5', 'vm-uuid': '335d5305-28e6-4766-b0b2-b56848ff8652'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:50:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:30 user nova-compute[71364]: INFO os_vif [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:80:f5,bridge_name='br-int',has_traffic_filtering=True,id=875f44f1-120e-48bc-9742-662c6bb93332,network=Network(35eb0a23-469f-4f8a-8c16-1cea8207fd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875f44f1-12')
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] No BDM found with device name hda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] No VIF found with MAC fa:16:3e:27:80:f5, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:50:31 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Using config drive
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] No VIF found with MAC fa:16:3e:c2:69:1f, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-f1c28cd5-7d67-4a05-ad3d-f05dd11e0d7d req-c93d5363-0b60-40cb-803a-1f28f95c51a6 service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f1c28cd5-7d67-4a05-ad3d-f05dd11e0d7d req-c93d5363-0b60-40cb-803a-1f28f95c51a6 service nova] Releasing lock "refresh_cache-5a3b5455-983c-4c30-b229-8922443af209" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquired lock "refresh_cache-5a3b5455-983c-4c30-b229-8922443af209" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:31 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Creating config drive at /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk.config
Apr 11 21:50:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplk6n7jow {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplk6n7jow" returned: 0 in 0.066s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-b8687e10-24f4-42db-854f-e3d361219411 req-75dc0a70-6a6f-4064-996b-bec19dd83644 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Updated VIF entry in instance network info cache for port 875f44f1-120e-48bc-9742-662c6bb93332. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-b8687e10-24f4-42db-854f-e3d361219411 req-75dc0a70-6a6f-4064-996b-bec19dd83644 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Updating instance_info_cache with network_info: [{"id": "875f44f1-120e-48bc-9742-662c6bb93332", "address": "fa:16:3e:27:80:f5", "network": {"id": "35eb0a23-469f-4f8a-8c16-1cea8207fd79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1614521033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875f44f1-12", "ovs_interfaceid": "875f44f1-120e-48bc-9742-662c6bb93332", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b8687e10-24f4-42db-854f-e3d361219411 req-75dc0a70-6a6f-4064-996b-bec19dd83644 service nova] Releasing lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-0381f12a-b0cc-4780-9a8a-6aa5a9300527 req-66e7069c-3343-485d-ad2e-0a209239f147 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Updated VIF entry in instance network info cache for port 2bf7ba51-4360-45c5-bada-6d7113ca3aa5. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-0381f12a-b0cc-4780-9a8a-6aa5a9300527 req-66e7069c-3343-485d-ad2e-0a209239f147 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Updating instance_info_cache with network_info: [{"id": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "address": "fa:16:3e:c2:69:1f", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7ba51-43", "ovs_interfaceid": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0381f12a-b0cc-4780-9a8a-6aa5a9300527 req-66e7069c-3343-485d-ad2e-0a209239f147 service nova] Releasing lock "refresh_cache-71a04a77-49b8-4d4a-bc66-e233aa7eab08" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Updating instance_info_cache with network_info: [{"id": "70618f68-d426-45e0-aa51-0bffb5b512f5", "address": "fa:16:3e:8e:c6:90", "network": {"id": "09ba5156-0533-4c89-98d7-01da7903e7fa", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1375351384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1a9b6214384320b7d75e890e569b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70618f68-d4", "ovs_interfaceid": "70618f68-d426-45e0-aa51-0bffb5b512f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Received event network-vif-plugged-327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] Acquiring lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] No waiting events found dispatching network-vif-plugged-327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:31 user nova-compute[71364]: WARNING nova.compute.manager [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Received unexpected event network-vif-plugged-327f645b-e31b-4f09-88d2-a53f8a29905c for instance with vm_state building and task_state spawning.
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Received event network-vif-plugged-327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] Acquiring lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] No waiting events found dispatching network-vif-plugged-327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:31 user nova-compute[71364]: WARNING nova.compute.manager [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Received unexpected event network-vif-plugged-327f645b-e31b-4f09-88d2-a53f8a29905c for instance with vm_state building and task_state spawning.
Apr 11 21:50:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Releasing lock "refresh_cache-5a3b5455-983c-4c30-b229-8922443af209" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Instance network_info: |[{"id": "70618f68-d426-45e0-aa51-0bffb5b512f5", "address": "fa:16:3e:8e:c6:90", "network": {"id": "09ba5156-0533-4c89-98d7-01da7903e7fa", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1375351384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1a9b6214384320b7d75e890e569b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70618f68-d4", "ovs_interfaceid": "70618f68-d426-45e0-aa51-0bffb5b512f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:50:31 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Start _get_guest_xml network_info=[{"id": "70618f68-d426-45e0-aa51-0bffb5b512f5", "address": "fa:16:3e:8e:c6:90", "network": {"id": "09ba5156-0533-4c89-98d7-01da7903e7fa", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1375351384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1a9b6214384320b7d75e890e569b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70618f68-d4", "ovs_interfaceid": "70618f68-d426-45e0-aa51-0bffb5b512f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:50:32 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:32 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1308388397',display_name='tempest-TestVolumeSwap-server-1308388397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1308388397',id=8,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLlXnNVA1T5XsCFlI4PF3YuZ0GMWMMo0en+L1/ri7g5cFYsvnRV6z0onBgVKwLns7DAdeah2eE5mMYlaYFYiwoReMMqywci8aYgGj8Yr7LcTsA2BZumJ7YQpkoAerHUdQ==',key_name='tempest-keypair-2140712073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be1a9b6214384320b7d75e890e569b01',ramdisk_id='',reservation_id='r-x0l58vmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1222066063',owner_user_name='tempest-TestVolumeSwap-1222066063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f11dee7865404b9271be236429db1f',uuid=5a3b5455-983c-4c30-b229-8922443af209,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70618f68-d426-45e0-aa51-0bffb5b512f5", "address": "fa:16:3e:8e:c6:90", "network": {"id": "09ba5156-0533-4c89-98d7-01da7903e7fa", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1375351384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1a9b6214384320b7d75e890e569b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70618f68-d4", "ovs_interfaceid": "70618f68-d426-45e0-aa51-0bffb5b512f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Converting VIF {"id": "70618f68-d426-45e0-aa51-0bffb5b512f5", "address": "fa:16:3e:8e:c6:90", "network": {"id": "09ba5156-0533-4c89-98d7-01da7903e7fa", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1375351384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1a9b6214384320b7d75e890e569b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70618f68-d4", "ovs_interfaceid": "70618f68-d426-45e0-aa51-0bffb5b512f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c6:90,bridge_name='br-int',has_traffic_filtering=True,id=70618f68-d426-45e0-aa51-0bffb5b512f5,network=Network(09ba5156-0533-4c89-98d7-01da7903e7fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70618f68-d4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.objects.instance [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a3b5455-983c-4c30-b229-8922443af209 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:50:32 user nova-compute[71364]:   <uuid>5a3b5455-983c-4c30-b229-8922443af209</uuid>
Apr 11 21:50:32 user nova-compute[71364]:   <name>instance-00000008</name>
Apr 11 21:50:32 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:50:32 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:50:32 user nova-compute[71364]:   <metadata>
Apr 11 21:50:32 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:50:32 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:50:32 user nova-compute[71364]:       <nova:name>tempest-TestVolumeSwap-server-1308388397</nova:name>
Apr 11 21:50:32 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:50:32</nova:creationTime>
Apr 11 21:50:32 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:50:32 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:50:32 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:50:32 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:50:32 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:50:32 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:50:32 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:50:32 user nova-compute[71364]:       <nova:owner>
Apr 11 21:50:32 user nova-compute[71364]:         <nova:user uuid="33f11dee7865404b9271be236429db1f">tempest-TestVolumeSwap-1222066063-project-member</nova:user>
Apr 11 21:50:32 user nova-compute[71364]:         <nova:project uuid="be1a9b6214384320b7d75e890e569b01">tempest-TestVolumeSwap-1222066063</nova:project>
Apr 11 21:50:32 user nova-compute[71364]:       </nova:owner>
Apr 11 21:50:32 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:50:32 user nova-compute[71364]:       <nova:ports>
Apr 11 21:50:32 user nova-compute[71364]:         <nova:port uuid="70618f68-d426-45e0-aa51-0bffb5b512f5">
Apr 11 21:50:32 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 21:50:32 user nova-compute[71364]:         </nova:port>
Apr 11 21:50:32 user nova-compute[71364]:       </nova:ports>
Apr 11 21:50:32 user nova-compute[71364]:     </nova:instance>
Apr 11 21:50:32 user nova-compute[71364]:   </metadata>
Apr 11 21:50:32 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:50:32 user nova-compute[71364]:     <system>
Apr 11 21:50:32 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:50:32 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:50:32 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:50:32 user nova-compute[71364]:       <entry name="serial">5a3b5455-983c-4c30-b229-8922443af209</entry>
Apr 11 21:50:32 user nova-compute[71364]:       <entry name="uuid">5a3b5455-983c-4c30-b229-8922443af209</entry>
Apr 11 21:50:32 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:50:32 user nova-compute[71364]:     </system>
Apr 11 21:50:32 user nova-compute[71364]:   </sysinfo>
Apr 11 21:50:32 user nova-compute[71364]:   <os>
Apr 11 21:50:32 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:50:32 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:50:32 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:50:32 user nova-compute[71364]:   </os>
Apr 11 21:50:32 user nova-compute[71364]:   <features>
Apr 11 21:50:32 user nova-compute[71364]:     <acpi/>
Apr 11 21:50:32 user nova-compute[71364]:     <apic/>
Apr 11 21:50:32 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:50:32 user nova-compute[71364]:   </features>
Apr 11 21:50:32 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:50:32 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:50:32 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:50:32 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:50:32 user nova-compute[71364]:   </clock>
Apr 11 21:50:32 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:50:32 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:50:32 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:50:32 user nova-compute[71364]:   </cpu>
Apr 11 21:50:32 user nova-compute[71364]:   <devices>
Apr 11 21:50:32 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:50:32 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:50:32 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk"/>
Apr 11 21:50:32 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:50:32 user nova-compute[71364]:     </disk>
Apr 11 21:50:32 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:50:32 user nova-compute[71364]:       <mac address="fa:16:3e:8e:c6:90"/>
Apr 11 21:50:32 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:32 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:50:32 user nova-compute[71364]:       <target dev="tap70618f68-d4"/>
Apr 11 21:50:32 user nova-compute[71364]:     </interface>
Apr 11 21:50:32 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:50:32 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/console.log" append="off"/>
Apr 11 21:50:32 user nova-compute[71364]:     </serial>
Apr 11 21:50:32 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:50:32 user nova-compute[71364]:     <video>
Apr 11 21:50:32 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:50:32 user nova-compute[71364]:     </video>
Apr 11 21:50:32 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:50:32 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:50:32 user nova-compute[71364]:     </rng>
Apr 11 21:50:32 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:50:32 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:50:32 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:50:32 user nova-compute[71364]:     </memballoon>
Apr 11 21:50:32 user nova-compute[71364]:   </devices>
Apr 11 21:50:32 user nova-compute[71364]: </domain>
Apr 11 21:50:32 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1308388397',display_name='tempest-TestVolumeSwap-server-1308388397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1308388397',id=8,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLlXnNVA1T5XsCFlI4PF3YuZ0GMWMMo0en+L1/ri7g5cFYsvnRV6z0onBgVKwLns7DAdeah2eE5mMYlaYFYiwoReMMqywci8aYgGj8Yr7LcTsA2BZumJ7YQpkoAerHUdQ==',key_name='tempest-keypair-2140712073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be1a9b6214384320b7d75e890e569b01',ramdisk_id='',reservation_id='r-x0l58vmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1222066063',owner_user_name='tempest-TestVolumeSwap-1222066063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:50:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f11dee7865404b9271be236429db1f',uuid=5a3b5455-983c-4c30-b229-8922443af209,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70618f68-d426-45e0-aa51-0bffb5b512f5", "address": "fa:16:3e:8e:c6:90", "network": {"id": "09ba5156-0533-4c89-98d7-01da7903e7fa", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1375351384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1a9b6214384320b7d75e890e569b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70618f68-d4", "ovs_interfaceid": "70618f68-d426-45e0-aa51-0bffb5b512f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Converting VIF {"id": "70618f68-d426-45e0-aa51-0bffb5b512f5", "address": "fa:16:3e:8e:c6:90", "network": {"id": "09ba5156-0533-4c89-98d7-01da7903e7fa", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1375351384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1a9b6214384320b7d75e890e569b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70618f68-d4", "ovs_interfaceid": "70618f68-d426-45e0-aa51-0bffb5b512f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c6:90,bridge_name='br-int',has_traffic_filtering=True,id=70618f68-d426-45e0-aa51-0bffb5b512f5,network=Network(09ba5156-0533-4c89-98d7-01da7903e7fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70618f68-d4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG os_vif [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c6:90,bridge_name='br-int',has_traffic_filtering=True,id=70618f68-d426-45e0-aa51-0bffb5b512f5,network=Network(09ba5156-0533-4c89-98d7-01da7903e7fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70618f68-d4') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70618f68-d4, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap70618f68-d4, col_values=(('external_ids', {'iface-id': '70618f68-d426-45e0-aa51-0bffb5b512f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:c6:90', 'vm-uuid': '5a3b5455-983c-4c30-b229-8922443af209'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:32 user nova-compute[71364]: INFO os_vif [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c6:90,bridge_name='br-int',has_traffic_filtering=True,id=70618f68-d426-45e0-aa51-0bffb5b512f5,network=Network(09ba5156-0533-4c89-98d7-01da7903e7fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70618f68-d4')
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:50:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] No VIF found with MAC fa:16:3e:8e:c6:90, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:50:33 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249832.999629, f279b153-a1c9-46f5-a0c5-4574ab956ba8 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:33 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] VM Resumed (Lifecycle Event)
Apr 11 21:50:33 user nova-compute[71364]: DEBUG nova.compute.manager [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:50:33 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:50:33 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Instance spawned successfully.
Apr 11 21:50:33 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:50:33 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:33 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:33 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:33 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:33 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:33 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:33 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:33 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249833.0011976, f279b153-a1c9-46f5-a0c5-4574ab956ba8 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:33 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] VM Started (Lifecycle Event)
Apr 11 21:50:33 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:33 user nova-compute[71364]: INFO nova.compute.manager [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Took 9.54 seconds to spawn the instance on the hypervisor.
Apr 11 21:50:33 user nova-compute[71364]: DEBUG nova.compute.manager [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:33 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:33 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:33 user nova-compute[71364]: INFO nova.compute.manager [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Took 11.11 seconds to build instance.
Apr 11 21:50:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.305s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:34 user nova-compute[71364]: DEBUG nova.compute.manager [req-c7cde59c-a8c7-4875-a86b-bdf36fe01770 req-9283772c-214c-4db9-9f75-60d3faef50d9 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Received event network-vif-plugged-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c7cde59c-a8c7-4875-a86b-bdf36fe01770 req-9283772c-214c-4db9-9f75-60d3faef50d9 service nova] Acquiring lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c7cde59c-a8c7-4875-a86b-bdf36fe01770 req-9283772c-214c-4db9-9f75-60d3faef50d9 service nova] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c7cde59c-a8c7-4875-a86b-bdf36fe01770 req-9283772c-214c-4db9-9f75-60d3faef50d9 service nova] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:34 user nova-compute[71364]: DEBUG nova.compute.manager [req-c7cde59c-a8c7-4875-a86b-bdf36fe01770 req-9283772c-214c-4db9-9f75-60d3faef50d9 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] No waiting events found dispatching network-vif-plugged-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:34 user nova-compute[71364]: WARNING nova.compute.manager [req-c7cde59c-a8c7-4875-a86b-bdf36fe01770 req-9283772c-214c-4db9-9f75-60d3faef50d9 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Received unexpected event network-vif-plugged-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 for instance with vm_state building and task_state spawning.
Apr 11 21:50:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:35 user nova-compute[71364]: DEBUG nova.compute.manager [req-af317d6c-1013-46e4-b63f-51285eb94463 req-e7b8ff6a-6d8e-47e9-9722-c47cfed27804 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received event network-vif-plugged-875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-af317d6c-1013-46e4-b63f-51285eb94463 req-e7b8ff6a-6d8e-47e9-9722-c47cfed27804 service nova] Acquiring lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-af317d6c-1013-46e4-b63f-51285eb94463 req-e7b8ff6a-6d8e-47e9-9722-c47cfed27804 service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-af317d6c-1013-46e4-b63f-51285eb94463 req-e7b8ff6a-6d8e-47e9-9722-c47cfed27804 service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:35 user nova-compute[71364]: DEBUG nova.compute.manager [req-af317d6c-1013-46e4-b63f-51285eb94463 req-e7b8ff6a-6d8e-47e9-9722-c47cfed27804 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] No waiting events found dispatching network-vif-plugged-875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:35 user nova-compute[71364]: WARNING nova.compute.manager [req-af317d6c-1013-46e4-b63f-51285eb94463 req-e7b8ff6a-6d8e-47e9-9722-c47cfed27804 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received unexpected event network-vif-plugged-875f44f1-120e-48bc-9742-662c6bb93332 for instance with vm_state building and task_state spawning.
Apr 11 21:50:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:36 user nova-compute[71364]: DEBUG nova.compute.manager [req-562c1544-c4d3-421f-8299-469ad4b3a15a req-b28d2f9e-e2f0-45bd-9389-7c02ccdced38 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Received event network-vif-plugged-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-562c1544-c4d3-421f-8299-469ad4b3a15a req-b28d2f9e-e2f0-45bd-9389-7c02ccdced38 service nova] Acquiring lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-562c1544-c4d3-421f-8299-469ad4b3a15a req-b28d2f9e-e2f0-45bd-9389-7c02ccdced38 service nova] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-562c1544-c4d3-421f-8299-469ad4b3a15a req-b28d2f9e-e2f0-45bd-9389-7c02ccdced38 service nova] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:36 user nova-compute[71364]: DEBUG nova.compute.manager [req-562c1544-c4d3-421f-8299-469ad4b3a15a req-b28d2f9e-e2f0-45bd-9389-7c02ccdced38 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] No waiting events found dispatching network-vif-plugged-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:36 user nova-compute[71364]: WARNING nova.compute.manager [req-562c1544-c4d3-421f-8299-469ad4b3a15a req-b28d2f9e-e2f0-45bd-9389-7c02ccdced38 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Received unexpected event network-vif-plugged-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 for instance with vm_state building and task_state spawning.
Apr 11 21:50:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received event network-vif-plugged-875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Acquiring lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] No waiting events found dispatching network-vif-plugged-875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:37 user nova-compute[71364]: WARNING nova.compute.manager [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received unexpected event network-vif-plugged-875f44f1-120e-48bc-9742-662c6bb93332 for instance with vm_state building and task_state spawning.
Apr 11 21:50:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Received event network-vif-plugged-70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Acquiring lock "5a3b5455-983c-4c30-b229-8922443af209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Lock "5a3b5455-983c-4c30-b229-8922443af209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Lock "5a3b5455-983c-4c30-b229-8922443af209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] No waiting events found dispatching network-vif-plugged-70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:37 user nova-compute[71364]: WARNING nova.compute.manager [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Received unexpected event network-vif-plugged-70618f68-d426-45e0-aa51-0bffb5b512f5 for instance with vm_state building and task_state spawning.
Apr 11 21:50:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Received event network-vif-plugged-70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:50:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Acquiring lock "5a3b5455-983c-4c30-b229-8922443af209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Lock "5a3b5455-983c-4c30-b229-8922443af209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Lock "5a3b5455-983c-4c30-b229-8922443af209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] No waiting events found dispatching network-vif-plugged-70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:50:37 user nova-compute[71364]: WARNING nova.compute.manager [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Received unexpected event network-vif-plugged-70618f68-d426-45e0-aa51-0bffb5b512f5 for instance with vm_state building and task_state spawning.
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249838.3632512, 71a04a77-49b8-4d4a-bc66-e233aa7eab08 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] VM Resumed (Lifecycle Event)
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Instance spawned successfully.
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249838.3650076, 71a04a77-49b8-4d4a-bc66-e233aa7eab08 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] VM Started (Lifecycle Event)
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Took 11.14 seconds to spawn the instance on the hypervisor.
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249838.588756, 335d5305-28e6-4766-b0b2-b56848ff8652 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] VM Resumed (Lifecycle Event)
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Instance spawned successfully.
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Instance spawned successfully.
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Took 12.52 seconds to build instance.
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.856s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249838.5891798, 335d5305-28e6-4766-b0b2-b56848ff8652 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] VM Started (Lifecycle Event)
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249838.5968444, 5a3b5455-983c-4c30-b229-8922443af209 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5a3b5455-983c-4c30-b229-8922443af209] VM Resumed (Lifecycle Event)
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5a3b5455-983c-4c30-b229-8922443af209] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249838.5998209, 5a3b5455-983c-4c30-b229-8922443af209 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5a3b5455-983c-4c30-b229-8922443af209] VM Started (Lifecycle Event)
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Took 12.37 seconds to spawn the instance on the hypervisor.
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Took 10.73 seconds to spawn the instance on the hypervisor.
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:50:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5a3b5455-983c-4c30-b229-8922443af209] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:50:38 user nova-compute[71364]: INFO nova.compute.manager [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Took 12.51 seconds to build instance.
Apr 11 21:50:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "5a3b5455-983c-4c30-b229-8922443af209" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.688s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:39 user nova-compute[71364]: INFO nova.compute.manager [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Took 13.89 seconds to build instance.
Apr 11 21:50:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "335d5305-28e6-4766-b0b2-b56848ff8652" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.114s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:50:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 21:50:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] There are 0 instances to clean {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 21:50:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:50:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71364) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 21:50:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:50:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:45 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:50:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:50:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:50:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-514f5cac-9b1d-42e9-9619-0a2ce6c82b14" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:50:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-514f5cac-9b1d-42e9-9619-0a2ce6c82b14" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:50:45 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:50:45 user nova-compute[71364]: DEBUG nova.objects.instance [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lazy-loading 'info_cache' on Instance uuid 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:50:46 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Updating instance_info_cache with network_info: [{"id": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "address": "fa:16:3e:85:6d:26", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34feb75-3b", "ovs_interfaceid": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:50:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-514f5cac-9b1d-42e9-9619-0a2ce6c82b14" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:50:46 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:50:46 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:50:46 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:50:47 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:50:47 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:50:47 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:50:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:48 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:50:48 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:50:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:49 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:50:49 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:50:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:49 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:50:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:50:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:50:53 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:53 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7596MB free_disk=26.572555541992188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 13124f93-665b-4107-bd71-16674bdb9a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance e627de16-3a8f-4510-8001-0e57a272b859 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 335d5305-28e6-4766-b0b2-b56848ff8652 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5a3b5455-983c-4c30-b229-8922443af209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing inventories for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating ProviderTree inventory for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating inventory in ProviderTree for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing aggregate associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, aggregates: None {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing trait associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:50:53 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:50:54 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:50:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.948s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:50:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:50:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:51:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:51:00 user nova-compute[71364]: INFO nova.compute.claims [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Claim successful on node user
Apr 11 21:51:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:00 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:51:00 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:51:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:51:01 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:51:01 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:51:01 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:51:01 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:51:01 user nova-compute[71364]: INFO nova.virt.block_device [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Booting with volume fa4d6272-d5c9-4230-bfae-3cc02e26769e at /dev/vda
Apr 11 21:51:01 user nova-compute[71364]: DEBUG nova.policy [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa98b435fa2346b880bef8fe46614ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6c690214fc4667b617cc760c352b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:51:01 user nova-compute[71364]: DEBUG os_brick.utils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:51:01 user nova-compute[71364]: INFO oslo.privsep.daemon [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpawep95al/privsep.sock']
Apr 11 21:51:01 user sudo[81573]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpawep95al/privsep.sock
Apr 11 21:51:01 user sudo[81573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 11 21:51:01 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Successfully created port: 4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:51:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:02 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Successfully created port: 84178c3a-ce1d-40e5-a8df-b01039c2e595 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:51:02 user sudo[81573]: pam_unix(sudo:session): session closed for user root
Apr 11 21:51:02 user nova-compute[71364]: INFO oslo.privsep.daemon [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Spawned new privsep daemon via rootwrap
Apr 11 21:51:02 user nova-compute[71364]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 11 21:51:02 user nova-compute[71364]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 11 21:51:02 user nova-compute[71364]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 11 21:51:02 user nova-compute[71364]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81576
Apr 11 21:51:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e7a8ef-1585-471d-8afb-ea0d2389818b]: (2,) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:02 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Successfully created port: b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3005e014-2ba0-42c4-852b-e178bbc0e63d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:03 user nova-compute[71364]: WARNING os_brick.initiator.connectors.nvmeof [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[87acb84a-193b-4453-8db2-4e3d3aaf99a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d630980e-99bf-4e6f-bd78-a11d4ecae888]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b5f9f6-082f-460b-a929-8a319cae5d31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:51:03 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:51:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d024988f-7a31-4399-a321-3fb1a4f449db]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG os_brick.utils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] <== get_connector_properties: return (1894ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updating existing volume attachment record: cae92b50-bed9-468a-9e64-4ddaa5a989d3 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:03 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Successfully created port: 2155540f-70ef-4d55-80dd-9f75bcd29afc {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:51:04 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Successfully created port: fdc8f7a5-1b0e-4564-a0c7-106abb209b20 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:51:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:05 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Successfully updated port: 4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:51:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-4dc12ace-f256-4128-ae08-b438e4b8db40 req-2a5172c2-8915-47d9-9456-4d38638464ee service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-changed-4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-4dc12ace-f256-4128-ae08-b438e4b8db40 req-2a5172c2-8915-47d9-9456-4d38638464ee service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing instance network info cache due to event network-changed-4bab3701-cae5-4cde-a61d-d4a11308c5bc. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:51:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4dc12ace-f256-4128-ae08-b438e4b8db40 req-2a5172c2-8915-47d9-9456-4d38638464ee service nova] Acquiring lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4dc12ace-f256-4128-ae08-b438e4b8db40 req-2a5172c2-8915-47d9-9456-4d38638464ee service nova] Acquired lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:05 user nova-compute[71364]: DEBUG nova.network.neutron [req-4dc12ace-f256-4128-ae08-b438e4b8db40 req-2a5172c2-8915-47d9-9456-4d38638464ee service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing network info cache for port 4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:51:05 user nova-compute[71364]: DEBUG nova.network.neutron [req-4dc12ace-f256-4128-ae08-b438e4b8db40 req-2a5172c2-8915-47d9-9456-4d38638464ee service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:51:05 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Successfully updated port: 053d127e-a3d3-40dd-92bb-c01cd0580309 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:51:05 user nova-compute[71364]: DEBUG nova.network.neutron [req-4dc12ace-f256-4128-ae08-b438e4b8db40 req-2a5172c2-8915-47d9-9456-4d38638464ee service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4dc12ace-f256-4128-ae08-b438e4b8db40 req-2a5172c2-8915-47d9-9456-4d38638464ee service nova] Releasing lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:06 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Successfully updated port: 7ff5ac2a-47b8-4a4e-9391-409086855c84 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-changed-053d127e-a3d3-40dd-92bb-c01cd0580309 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing instance network info cache due to event network-changed-053d127e-a3d3-40dd-92bb-c01cd0580309. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] Acquiring lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] Acquired lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG nova.network.neutron [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing network info cache for port 053d127e-a3d3-40dd-92bb-c01cd0580309 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG nova.network.neutron [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG nova.network.neutron [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] Releasing lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-changed-7ff5ac2a-47b8-4a4e-9391-409086855c84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing instance network info cache due to event network-changed-7ff5ac2a-47b8-4a4e-9391-409086855c84. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] Acquiring lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] Acquired lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG nova.network.neutron [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing network info cache for port 7ff5ac2a-47b8-4a4e-9391-409086855c84 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:51:07 user nova-compute[71364]: INFO nova.virt.block_device [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Booting with volume 88da00ff-62d9-4085-8048-3618f2fea973 at /dev/vdb
Apr 11 21:51:07 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Successfully updated port: 84178c3a-ce1d-40e5-a8df-b01039c2e595 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG nova.network.neutron [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG os_brick.utils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d917d83d-adda-402c-a5ff-d5a9fb809575]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa99b5ec-b85a-4095-9534-6793ac73ced6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0905943c-d33b-4038-a2f7-afd1a53eebba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d64f09-385f-49ae-9115-accf69b1b305]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:51:07 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72ba8d2-a0d2-4c3a-9ff1-5c1ade6960ea]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG os_brick.utils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updating existing volume attachment record: 8762c894-fd8f-48a8-8f87-09f0191fbd78 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG nova.network.neutron [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] Releasing lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:08 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Successfully updated port: b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:51:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-changed-84178c3a-ce1d-40e5-a8df-b01039c2e595 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing instance network info cache due to event network-changed-84178c3a-ce1d-40e5-a8df-b01039c2e595. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] Acquiring lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] Acquired lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG nova.network.neutron [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing network info cache for port 84178c3a-ce1d-40e5-a8df-b01039c2e595 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Successfully updated port: 2155540f-70ef-4d55-80dd-9f75bcd29afc {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG nova.network.neutron [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG nova.network.neutron [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] Releasing lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-changed-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing instance network info cache due to event network-changed-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] Acquiring lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] Acquired lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG nova.network.neutron [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing network info cache for port b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG nova.network.neutron [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG nova.network.neutron [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] Releasing lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:10 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Successfully updated port: fdc8f7a5-1b0e-4564-a0c7-106abb209b20 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:51:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquired lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:10 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:51:10 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:51:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-changed-2155540f-70ef-4d55-80dd-9f75bcd29afc {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing instance network info cache due to event network-changed-2155540f-70ef-4d55-80dd-9f75bcd29afc. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:51:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] Acquiring lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "76315af2-c4b9-4ad5-98ea-81826524d63e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:11 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:51:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:51:12 user nova-compute[71364]: INFO nova.compute.claims [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Claim successful on node user
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updating instance_info_cache with network_info: [{"id": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "address": "fa:16:3e:08:e9:e5", "network": {"id": "fe19ecab-8008-4c75-b42c-893bf768d60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366505631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bab3701-ca", "ovs_interfaceid": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053d127e-a3d3-40dd-92bb-c01cd0580309", "address": "fa:16:3e:fc:20:36", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053d127e-a3", "ovs_interfaceid": "053d127e-a3d3-40dd-92bb-c01cd0580309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "address": "fa:16:3e:84:11:12", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5ac2a-47", "ovs_interfaceid": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "address": "fa:16:3e:de:5c:a4", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84178c3a-ce", "ovs_interfaceid": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "address": "fa:16:3e:11:2c:22", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb863f6b5-96", "ovs_interfaceid": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "address": "fa:16:3e:5d:35:f8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2155540f-70", "ovs_interfaceid": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "address": "fa:16:3e:68:6d:d8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc8f7a5-1b", "ovs_interfaceid": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:12 user nova-compute[71364]: INFO nova.virt.block_device [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Booting with volume 2ba36538-41e5-4c4a-8b40-4e402df5d540 at /dev/vdc
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Releasing lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Instance network_info: |[{"id": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "address": "fa:16:3e:08:e9:e5", "network": {"id": "fe19ecab-8008-4c75-b42c-893bf768d60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366505631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bab3701-ca", "ovs_interfaceid": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053d127e-a3d3-40dd-92bb-c01cd0580309", "address": "fa:16:3e:fc:20:36", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053d127e-a3", "ovs_interfaceid": "053d127e-a3d3-40dd-92bb-c01cd0580309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "address": "fa:16:3e:84:11:12", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5ac2a-47", "ovs_interfaceid": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "address": "fa:16:3e:de:5c:a4", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84178c3a-ce", "ovs_interfaceid": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "address": "fa:16:3e:11:2c:22", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb863f6b5-96", "ovs_interfaceid": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "address": "fa:16:3e:5d:35:f8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2155540f-70", "ovs_interfaceid": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "address": "fa:16:3e:68:6d:d8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc8f7a5-1b", "ovs_interfaceid": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] Acquired lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.network.neutron [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing network info cache for port 2155540f-70ef-4d55-80dd-9f75bcd29afc {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG os_brick.utils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8b5701-9da8-408c-b3dc-9fc042b2164e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e49f121-33d2-43b7-a8af-53ae39bfbb40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[126d2e26-0ea1-49a0-acb9-f6ce6ed75d0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[97206625-bee8-4791-b7e2-608e7d48c302]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:51:12 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d6f226-85c6-4748-b6d5-cc5044ef72c4]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG os_brick.utils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updating existing volume attachment record: a226f6c2-1923-4841-b60d-50f7bc44f154 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:51:12 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.network.neutron [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updated VIF entry in instance network info cache for port 2155540f-70ef-4d55-80dd-9f75bcd29afc. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.network.neutron [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updating instance_info_cache with network_info: [{"id": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "address": "fa:16:3e:08:e9:e5", "network": {"id": "fe19ecab-8008-4c75-b42c-893bf768d60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366505631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bab3701-ca", "ovs_interfaceid": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053d127e-a3d3-40dd-92bb-c01cd0580309", "address": "fa:16:3e:fc:20:36", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053d127e-a3", "ovs_interfaceid": "053d127e-a3d3-40dd-92bb-c01cd0580309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "address": "fa:16:3e:84:11:12", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5ac2a-47", "ovs_interfaceid": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "address": "fa:16:3e:de:5c:a4", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84178c3a-ce", "ovs_interfaceid": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "address": "fa:16:3e:11:2c:22", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb863f6b5-96", "ovs_interfaceid": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "address": "fa:16:3e:5d:35:f8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2155540f-70", "ovs_interfaceid": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "address": "fa:16:3e:68:6d:d8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc8f7a5-1b", "ovs_interfaceid": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] Releasing lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.compute.manager [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-changed-fdc8f7a5-1b0e-4564-a0c7-106abb209b20 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.compute.manager [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing instance network info cache due to event network-changed-fdc8f7a5-1b0e-4564-a0c7-106abb209b20. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] Acquiring lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] Acquired lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.network.neutron [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing network info cache for port fdc8f7a5-1b0e-4564-a0c7-106abb209b20 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.policy [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1aeabb5e8b4b463e8481e4ae8ecc1153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5d7d74644c8bb2f768e9a871f75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:51:12 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Creating image(s)
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "/opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "/opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "/opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk 1073741824" returned: 0 in 0.046s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG nova.network.neutron [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updated VIF entry in instance network info cache for port fdc8f7a5-1b0e-4564-a0c7-106abb209b20. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG nova.network.neutron [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updating instance_info_cache with network_info: [{"id": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "address": "fa:16:3e:08:e9:e5", "network": {"id": "fe19ecab-8008-4c75-b42c-893bf768d60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366505631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bab3701-ca", "ovs_interfaceid": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053d127e-a3d3-40dd-92bb-c01cd0580309", "address": "fa:16:3e:fc:20:36", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053d127e-a3", "ovs_interfaceid": "053d127e-a3d3-40dd-92bb-c01cd0580309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "address": "fa:16:3e:84:11:12", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5ac2a-47", "ovs_interfaceid": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "address": "fa:16:3e:de:5c:a4", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84178c3a-ce", "ovs_interfaceid": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "address": "fa:16:3e:11:2c:22", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb863f6b5-96", "ovs_interfaceid": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "address": "fa:16:3e:5d:35:f8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2155540f-70", "ovs_interfaceid": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "address": "fa:16:3e:68:6d:d8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc8f7a5-1b", "ovs_interfaceid": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] Releasing lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Cannot resize image /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG nova.objects.instance [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lazy-loading 'migration_context' on Instance uuid 76315af2-c4b9-4ad5-98ea-81826524d63e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Ensure instance console log exists: /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Successfully created port: a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:51:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Successfully updated port: a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "refresh_cache-76315af2-c4b9-4ad5-98ea-81826524d63e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquired lock "refresh_cache-76315af2-c4b9-4ad5-98ea-81826524d63e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.compute.manager [req-30e75276-768c-40c0-819a-170edc686aec req-199b1e95-e301-40b9-9068-3de9d0b50a56 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Received event network-changed-a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.compute.manager [req-30e75276-768c-40c0-819a-170edc686aec req-199b1e95-e301-40b9-9068-3de9d0b50a56 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Refreshing instance network info cache due to event network-changed-a85cff03-bd83-4fef-8abc-1615e5ceebd6. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-30e75276-768c-40c0-819a-170edc686aec req-199b1e95-e301-40b9-9068-3de9d0b50a56 service nova] Acquiring lock "refresh_cache-76315af2-c4b9-4ad5-98ea-81826524d63e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Updating instance_info_cache with network_info: [{"id": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "address": "fa:16:3e:00:33:22", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85cff03-bd", "ovs_interfaceid": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Releasing lock "refresh_cache-76315af2-c4b9-4ad5-98ea-81826524d63e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Instance network_info: |[{"id": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "address": "fa:16:3e:00:33:22", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85cff03-bd", "ovs_interfaceid": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-30e75276-768c-40c0-819a-170edc686aec req-199b1e95-e301-40b9-9068-3de9d0b50a56 service nova] Acquired lock "refresh_cache-76315af2-c4b9-4ad5-98ea-81826524d63e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.network.neutron [req-30e75276-768c-40c0-819a-170edc686aec req-199b1e95-e301-40b9-9068-3de9d0b50a56 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Refreshing network info cache for port a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Start _get_guest_xml network_info=[{"id": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "address": "fa:16:3e:00:33:22", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85cff03-bd", "ovs_interfaceid": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:51:14 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:51:14 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-761882032',display_name='tempest-TestStampPattern-server-761882032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-761882032',id=10,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpCRhqzUB7FAJyPBKJlCQG79NsEN1MlKiYeS6HxcdWPP0UKr1248UxMjqeqQ05u0XR5/7y/57d+iYThyqW9HhypiFf/4Et50oE3GriCFvwstOcaJA+DGlCD4+QUkbFCBA==',key_name='tempest-TestStampPattern-1506752109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8df5d7d74644c8bb2f768e9a871f75c',ramdisk_id='',reservation_id='r-jd0mba8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1188732380',owner_user_name='tempest-TestStampPattern-1188732380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:13Z,user_data=None,user_id='1aeabb5e8b4b463e8481e4ae8ecc1153',uuid=76315af2-c4b9-4ad5-98ea-81826524d63e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "address": "fa:16:3e:00:33:22", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85cff03-bd", "ovs_interfaceid": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Converting VIF {"id": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "address": "fa:16:3e:00:33:22", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85cff03-bd", "ovs_interfaceid": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:33:22,bridge_name='br-int',has_traffic_filtering=True,id=a85cff03-bd83-4fef-8abc-1615e5ceebd6,network=Network(ba787967-1d37-4f5f-8a91-3e720641c16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa85cff03-bd') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.objects.instance [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lazy-loading 'pci_devices' on Instance uuid 76315af2-c4b9-4ad5-98ea-81826524d63e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:51:14 user nova-compute[71364]:   <uuid>76315af2-c4b9-4ad5-98ea-81826524d63e</uuid>
Apr 11 21:51:14 user nova-compute[71364]:   <name>instance-0000000a</name>
Apr 11 21:51:14 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:51:14 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:51:14 user nova-compute[71364]:   <metadata>
Apr 11 21:51:14 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:51:14 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:51:14 user nova-compute[71364]:       <nova:name>tempest-TestStampPattern-server-761882032</nova:name>
Apr 11 21:51:14 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:51:14</nova:creationTime>
Apr 11 21:51:14 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:51:14 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:51:14 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:51:14 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:51:14 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:51:14 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:51:14 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:51:14 user nova-compute[71364]:       <nova:owner>
Apr 11 21:51:14 user nova-compute[71364]:         <nova:user uuid="1aeabb5e8b4b463e8481e4ae8ecc1153">tempest-TestStampPattern-1188732380-project-member</nova:user>
Apr 11 21:51:14 user nova-compute[71364]:         <nova:project uuid="b8df5d7d74644c8bb2f768e9a871f75c">tempest-TestStampPattern-1188732380</nova:project>
Apr 11 21:51:14 user nova-compute[71364]:       </nova:owner>
Apr 11 21:51:14 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:51:14 user nova-compute[71364]:       <nova:ports>
Apr 11 21:51:14 user nova-compute[71364]:         <nova:port uuid="a85cff03-bd83-4fef-8abc-1615e5ceebd6">
Apr 11 21:51:14 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 21:51:14 user nova-compute[71364]:         </nova:port>
Apr 11 21:51:14 user nova-compute[71364]:       </nova:ports>
Apr 11 21:51:14 user nova-compute[71364]:     </nova:instance>
Apr 11 21:51:14 user nova-compute[71364]:   </metadata>
Apr 11 21:51:14 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:51:14 user nova-compute[71364]:     <system>
Apr 11 21:51:14 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:51:14 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:51:14 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:51:14 user nova-compute[71364]:       <entry name="serial">76315af2-c4b9-4ad5-98ea-81826524d63e</entry>
Apr 11 21:51:14 user nova-compute[71364]:       <entry name="uuid">76315af2-c4b9-4ad5-98ea-81826524d63e</entry>
Apr 11 21:51:14 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:51:14 user nova-compute[71364]:     </system>
Apr 11 21:51:14 user nova-compute[71364]:   </sysinfo>
Apr 11 21:51:14 user nova-compute[71364]:   <os>
Apr 11 21:51:14 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:51:14 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:51:14 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:51:14 user nova-compute[71364]:   </os>
Apr 11 21:51:14 user nova-compute[71364]:   <features>
Apr 11 21:51:14 user nova-compute[71364]:     <acpi/>
Apr 11 21:51:14 user nova-compute[71364]:     <apic/>
Apr 11 21:51:14 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:51:14 user nova-compute[71364]:   </features>
Apr 11 21:51:14 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:51:14 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:51:14 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:51:14 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:51:14 user nova-compute[71364]:   </clock>
Apr 11 21:51:14 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:51:14 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:51:14 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:51:14 user nova-compute[71364]:   </cpu>
Apr 11 21:51:14 user nova-compute[71364]:   <devices>
Apr 11 21:51:14 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:51:14 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:51:14 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk"/>
Apr 11 21:51:14 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:51:14 user nova-compute[71364]:     </disk>
Apr 11 21:51:14 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:51:14 user nova-compute[71364]:       <mac address="fa:16:3e:00:33:22"/>
Apr 11 21:51:14 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:51:14 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:51:14 user nova-compute[71364]:       <target dev="tapa85cff03-bd"/>
Apr 11 21:51:14 user nova-compute[71364]:     </interface>
Apr 11 21:51:14 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:51:14 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/console.log" append="off"/>
Apr 11 21:51:14 user nova-compute[71364]:     </serial>
Apr 11 21:51:14 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:51:14 user nova-compute[71364]:     <video>
Apr 11 21:51:14 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:51:14 user nova-compute[71364]:     </video>
Apr 11 21:51:14 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:51:14 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:51:14 user nova-compute[71364]:     </rng>
Apr 11 21:51:14 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:51:14 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:51:14 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:51:14 user nova-compute[71364]:     </memballoon>
Apr 11 21:51:14 user nova-compute[71364]:   </devices>
Apr 11 21:51:14 user nova-compute[71364]: </domain>
Apr 11 21:51:14 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-761882032',display_name='tempest-TestStampPattern-server-761882032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-761882032',id=10,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpCRhqzUB7FAJyPBKJlCQG79NsEN1MlKiYeS6HxcdWPP0UKr1248UxMjqeqQ05u0XR5/7y/57d+iYThyqW9HhypiFf/4Et50oE3GriCFvwstOcaJA+DGlCD4+QUkbFCBA==',key_name='tempest-TestStampPattern-1506752109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8df5d7d74644c8bb2f768e9a871f75c',ramdisk_id='',reservation_id='r-jd0mba8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1188732380',owner_user_name='tempest-TestStampPattern-1188732380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:13Z,user_data=None,user_id='1aeabb5e8b4b463e8481e4ae8ecc1153',uuid=76315af2-c4b9-4ad5-98ea-81826524d63e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "address": "fa:16:3e:00:33:22", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85cff03-bd", "ovs_interfaceid": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Converting VIF {"id": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "address": "fa:16:3e:00:33:22", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85cff03-bd", "ovs_interfaceid": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:33:22,bridge_name='br-int',has_traffic_filtering=True,id=a85cff03-bd83-4fef-8abc-1615e5ceebd6,network=Network(ba787967-1d37-4f5f-8a91-3e720641c16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa85cff03-bd') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG os_vif [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:33:22,bridge_name='br-int',has_traffic_filtering=True,id=a85cff03-bd83-4fef-8abc-1615e5ceebd6,network=Network(ba787967-1d37-4f5f-8a91-3e720641c16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa85cff03-bd') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa85cff03-bd, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa85cff03-bd, col_values=(('external_ids', {'iface-id': 'a85cff03-bd83-4fef-8abc-1615e5ceebd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:33:22', 'vm-uuid': '76315af2-c4b9-4ad5-98ea-81826524d63e'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:14 user nova-compute[71364]: INFO os_vif [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:33:22,bridge_name='br-int',has_traffic_filtering=True,id=a85cff03-bd83-4fef-8abc-1615e5ceebd6,network=Network(ba787967-1d37-4f5f-8a91-3e720641c16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa85cff03-bd')
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] No VIF found with MAC fa:16:3e:00:33:22, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.network.neutron [req-30e75276-768c-40c0-819a-170edc686aec req-199b1e95-e301-40b9-9068-3de9d0b50a56 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Updated VIF entry in instance network info cache for port a85cff03-bd83-4fef-8abc-1615e5ceebd6. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG nova.network.neutron [req-30e75276-768c-40c0-819a-170edc686aec req-199b1e95-e301-40b9-9068-3de9d0b50a56 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Updating instance_info_cache with network_info: [{"id": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "address": "fa:16:3e:00:33:22", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85cff03-bd", "ovs_interfaceid": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-30e75276-768c-40c0-819a-170edc686aec req-199b1e95-e301-40b9-9068-3de9d0b50a56 service nova] Releasing lock "refresh_cache-76315af2-c4b9-4ad5-98ea-81826524d63e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.compute.manager [req-1930e5a0-6358-4710-9a8d-25a37b0b35f6 req-c7579844-ead2-43e3-87c3-44530d3fab9e service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Received event network-vif-plugged-a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1930e5a0-6358-4710-9a8d-25a37b0b35f6 req-c7579844-ead2-43e3-87c3-44530d3fab9e service nova] Acquiring lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1930e5a0-6358-4710-9a8d-25a37b0b35f6 req-c7579844-ead2-43e3-87c3-44530d3fab9e service nova] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1930e5a0-6358-4710-9a8d-25a37b0b35f6 req-c7579844-ead2-43e3-87c3-44530d3fab9e service nova] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.compute.manager [req-1930e5a0-6358-4710-9a8d-25a37b0b35f6 req-c7579844-ead2-43e3-87c3-44530d3fab9e service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] No waiting events found dispatching network-vif-plugged-a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:16 user nova-compute[71364]: WARNING nova.compute.manager [req-1930e5a0-6358-4710-9a8d-25a37b0b35f6 req-c7579844-ead2-43e3-87c3-44530d3fab9e service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Received unexpected event network-vif-plugged-a85cff03-bd83-4fef-8abc-1615e5ceebd6 for instance with vm_state building and task_state spawning.
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:51:16 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Creating image(s)
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Ensure instance console log exists: /opt/stack/data/nova/instances/b38bd805-2d70-441e-8853-73d4e092f4dc/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Start _get_guest_xml network_info=[{"id": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "address": "fa:16:3e:08:e9:e5", "network": {"id": "fe19ecab-8008-4c75-b42c-893bf768d60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366505631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bab3701-ca", "ovs_interfaceid": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053d127e-a3d3-40dd-92bb-c01cd0580309", "address": "fa:16:3e:fc:20:36", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053d127e-a3", "ovs_interfaceid": "053d127e-a3d3-40dd-92bb-c01cd0580309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "address": "fa:16:3e:84:11:12", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5ac2a-47", "ovs_interfaceid": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "address": "fa:16:3e:de:5c:a4", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84178c3a-ce", "ovs_interfaceid": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "address": "fa:16:3e:11:2c:22", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb863f6b5-96", "ovs_interfaceid": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "address": "fa:16:3e:5d:35:f8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2155540f-70", "ovs_interfaceid": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "address": "fa:16:3e:68:6d:d8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc8f7a5-1b", "ovs_interfaceid": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzfpdhUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b38bd805-2d70-441e-8853-73d4e092f4dc', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa4d6272-d5c9-4230-bfae-3cc02e26769e', 'serial': 'fa4d6272-d5c9-4230-bfae-3cc02e26769e'}, 'attachment_id': 'cae92b50-bed9-468a-9e64-4ddaa5a989d3', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIgxfeZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b38bd805-2d70-441e-8853-73d4e092f4dc', 'attached_at': '', 'detached_at': '', 'volume_id': '88da00ff-62d9-4085-8048-3618f2fea973', 'serial': '88da00ff-62d9-4085-8048-3618f2fea973'}, 'attachment_id': '8762c894-fd8f-48a8-8f87-09f0191fbd78', 'mount_device': '/dev/vdb', 'boot_index': 1, 'guest_format': None, 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPQybtlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b38bd805-2d70-441e-8853-73d4e092f4dc', 'attached_at': '', 'detached_at': '', 'volume_id': '2ba36538-41e5-4c4a-8b40-4e402df5d540', 'serial': '2ba36538-41e5-4c4a-8b40-4e402df5d540'}, 'attachment_id': 'a226f6c2-1923-4841-b60d-50f7bc44f154', 'mount_device': '/dev/vdc', 'boot_index': 2, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:16 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:51:16 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connector [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Factory for ISCSI on None {{(pid=71364) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzfpdhUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:51:16 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:51:16 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:51:16 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:51:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0853d8-3d0f-4405-b2c1-a292e471f569]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:51:16 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f230f2-a16f-4905-9189-afba3073d383]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e] added
Apr 11 21:51:16 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06d4aea-e62a-433a-99ea-7f64eeee38b6]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[070518ec-e2a4-4dd5-857b-3bb1abd9916b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OzfpdhUs {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OzfpdhUs" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c577a572-e6ea-46f8-a380-1fa52b0e8281]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OzfpdhUs'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[30888665-1478-455c-9696-cfe5a8406ca1]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed07d3b-37c5-4c58-9f07-753e7a378acd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:51:16 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:51:16 user nova-compute[71364]:  {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:51:16 user nova-compute[71364]: WARNING os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 21:51:16 user nova-compute[71364]: 
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[90403910-07ab-4afe-8ba1-282be269c38d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e, portal: 172.16.0.220,3260]
Apr 11 21:51:16 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e, portal: 172.16.0.220,3260] successful.
Apr 11 21:51:16 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6e00d1-7068-4d6a-83a9-931e58f0a3d6]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b41024-b2cd-437b-84d8-01d6d169ab87]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:51:16 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:51:16 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f55c29-bbb4-4126-a84e-3b868c5da706]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:51:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzfpdhUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:51:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:51:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23135343039353862', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:51:17 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135343039353862', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIgxfeZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:51:18 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:51:18 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:51:18 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99ce902-aeda-41f9-9e4b-874cd4a42231]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:51:18 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[76365c40-6350-4bd0-b2a6-3870cdcd2727]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973] added
Apr 11 21:51:18 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a6421f-c384-47b4-91c5-4e0d3793b77d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7d28f5-99b3-4b09-8ca0-2202864a367a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIgxfeZr {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249878.1487417, 76315af2-c4b9-4ad5-98ea-81826524d63e => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:51:18 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] VM Resumed (Lifecycle Event)
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:51:18 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Instance spawned successfully.
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIgxfeZr" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43c41d7-20ac-4d28-a292-3306d9d59483]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sIgxfeZr'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[143bd647-4d00-401f-b1f2-df19753e3499]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:18 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249878.150924, 76315af2-c4b9-4ad5-98ea-81826524d63e => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:51:18 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] VM Started (Lifecycle Event)
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7507c02-496a-41d0-8f17-dd732e7f4068]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:51:18 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:51:18 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:51:18 user nova-compute[71364]: INFO nova.compute.manager [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Took 5.60 seconds to spawn the instance on the hypervisor.
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:51:18 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba0b019-8d65-4bcf-970e-7689a8bbaab8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973, portal: 172.16.0.220,3260]
Apr 11 21:51:18 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973, portal: 172.16.0.220,3260] successful.
Apr 11 21:51:18 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-23196877-74ef-4e2e-8ed3-2c2c8ffe5cd7 req-46827369-f1cd-4da5-b0a5-3e568be37097 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Received event network-vif-plugged-a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23196877-74ef-4e2e-8ed3-2c2c8ffe5cd7 req-46827369-f1cd-4da5-b0a5-3e568be37097 service nova] Acquiring lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23196877-74ef-4e2e-8ed3-2c2c8ffe5cd7 req-46827369-f1cd-4da5-b0a5-3e568be37097 service nova] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23196877-74ef-4e2e-8ed3-2c2c8ffe5cd7 req-46827369-f1cd-4da5-b0a5-3e568be37097 service nova] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-23196877-74ef-4e2e-8ed3-2c2c8ffe5cd7 req-46827369-f1cd-4da5-b0a5-3e568be37097 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] No waiting events found dispatching network-vif-plugged-a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:18 user nova-compute[71364]: WARNING nova.compute.manager [req-23196877-74ef-4e2e-8ed3-2c2c8ffe5cd7 req-46827369-f1cd-4da5-b0a5-3e568be37097 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Received unexpected event network-vif-plugged-a85cff03-bd83-4fef-8abc-1615e5ceebd6 for instance with vm_state building and task_state spawning.
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f6c411-601c-4f41-89dc-cc326646c4c2]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f551e9e8-0600-4375-a891-2bb3a5ab01ce]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:51:18 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:51:18 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:51:18 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:51:18 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc3e988-0470-43bf-9b62-643956da2b96]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIgxfeZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:51:18 user nova-compute[71364]: INFO nova.compute.manager [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Took 6.41 seconds to build instance.
Apr 11 21:51:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.505s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23162333634333264', 'path': '/dev/sdc'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162333634333264', 'path': '/dev/sdc'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPQybtlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:51:19 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:51:19 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:51:19 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd677445-f27c-4561-ae47-082850343572]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:51:19 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea4dd30-de4f-495b-8857-487fecba2aac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540] added
Apr 11 21:51:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9858151b-3b8d-436d-94a6-93b50a9305c5]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea44cea6-f18f-469d-b8e6-23558fdbe3a8]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wPQybtlj {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wPQybtlj" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[119ad724-907e-49c4-81ef-2fb7bfb2ccc5]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wPQybtlj'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e418620e-20e7-40f2-b6e4-bed83ce4a7f4]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[406dabe8-6d10-4c00-b98a-f49630abda02]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:51:19 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:51:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:51:19 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:51:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4427f034-cf95-435e-80ee-bf2ea58b950c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540, portal: 172.16.0.220,3260]
Apr 11 21:51:19 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540, portal: 172.16.0.220,3260] successful.
Apr 11 21:51:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.058s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6254cb7-6224-4618-a11a-79c839bd6c45]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe37c1fc-854f-4ca7-bd3c-7a8bc667e2bb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:51:19 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:51:19 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:51:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:51:19 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:51:19 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:51:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dec409-e8fc-4dc8-8037-c39a246dd643]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:51:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPQybtlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26334623165356363', 'path': '/dev/sdd'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334623165356363', 'path': '/dev/sdd'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "address": "fa:16:3e:08:e9:e5", "network": {"id": "fe19ecab-8008-4c75-b42c-893bf768d60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366505631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bab3701-ca", "ovs_interfaceid": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "address": "fa:16:3e:08:e9:e5", "network": {"id": "fe19ecab-8008-4c75-b42c-893bf768d60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366505631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bab3701-ca", "ovs_interfaceid": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=4bab3701-cae5-4cde-a61d-d4a11308c5bc,network=Network(fe19ecab-8008-4c75-b42c-893bf768d60b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bab3701-ca') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "053d127e-a3d3-40dd-92bb-c01cd0580309", "address": "fa:16:3e:fc:20:36", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053d127e-a3", "ovs_interfaceid": "053d127e-a3d3-40dd-92bb-c01cd0580309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "053d127e-a3d3-40dd-92bb-c01cd0580309", "address": "fa:16:3e:fc:20:36", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053d127e-a3", "ovs_interfaceid": "053d127e-a3d3-40dd-92bb-c01cd0580309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:20:36,bridge_name='br-int',has_traffic_filtering=True,id=053d127e-a3d3-40dd-92bb-c01cd0580309,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap053d127e-a3') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "address": "fa:16:3e:84:11:12", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5ac2a-47", "ovs_interfaceid": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "address": "fa:16:3e:84:11:12", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5ac2a-47", "ovs_interfaceid": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:11:12,bridge_name='br-int',has_traffic_filtering=True,id=7ff5ac2a-47b8-4a4e-9391-409086855c84,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ff5ac2a-47') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "address": "fa:16:3e:de:5c:a4", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84178c3a-ce", "ovs_interfaceid": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "address": "fa:16:3e:de:5c:a4", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84178c3a-ce", "ovs_interfaceid": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:5c:a4,bridge_name='br-int',has_traffic_filtering=True,id=84178c3a-ce1d-40e5-a8df-b01039c2e595,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84178c3a-ce') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "address": "fa:16:3e:11:2c:22", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb863f6b5-96", "ovs_interfaceid": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "address": "fa:16:3e:11:2c:22", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb863f6b5-96", "ovs_interfaceid": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:2c:22,bridge_name='br-int',has_traffic_filtering=True,id=b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb863f6b5-96') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "address": "fa:16:3e:5d:35:f8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2155540f-70", "ovs_interfaceid": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "address": "fa:16:3e:5d:35:f8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2155540f-70", "ovs_interfaceid": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:35:f8,bridge_name='br-int',has_traffic_filtering=True,id=2155540f-70ef-4d55-80dd-9f75bcd29afc,network=Network(0d00e759-61ae-4b5a-81a5-dda1e2ba7670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2155540f-70') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "address": "fa:16:3e:68:6d:d8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc8f7a5-1b", "ovs_interfaceid": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "address": "fa:16:3e:68:6d:d8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc8f7a5-1b", "ovs_interfaceid": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:6d:d8,bridge_name='br-int',has_traffic_filtering=True,id=fdc8f7a5-1b0e-4564-a0c7-106abb209b20,network=Network(0d00e759-61ae-4b5a-81a5-dda1e2ba7670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc8f7a5-1b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.objects.instance [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lazy-loading 'pci_devices' on Instance uuid b38bd805-2d70-441e-8853-73d4e092f4dc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:51:20 user nova-compute[71364]:   <uuid>b38bd805-2d70-441e-8853-73d4e092f4dc</uuid>
Apr 11 21:51:20 user nova-compute[71364]:   <name>instance-00000009</name>
Apr 11 21:51:20 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:51:20 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:51:20 user nova-compute[71364]:   <metadata>
Apr 11 21:51:20 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:51:20 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:51:20 user nova-compute[71364]:       <nova:name>tempest-device-tagging-server-1787126394</nova:name>
Apr 11 21:51:20 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:51:16</nova:creationTime>
Apr 11 21:51:20 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:51:20 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:51:20 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:51:20 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:51:20 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:51:20 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:51:20 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:51:20 user nova-compute[71364]:       <nova:owner>
Apr 11 21:51:20 user nova-compute[71364]:         <nova:user uuid="fa98b435fa2346b880bef8fe46614ba4">tempest-TaggedBootDevicesTest_v242-1290793725-project-member</nova:user>
Apr 11 21:51:20 user nova-compute[71364]:         <nova:project uuid="0b6c690214fc4667b617cc760c352b30">tempest-TaggedBootDevicesTest_v242-1290793725</nova:project>
Apr 11 21:51:20 user nova-compute[71364]:       </nova:owner>
Apr 11 21:51:20 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:51:20 user nova-compute[71364]:       <nova:ports>
Apr 11 21:51:20 user nova-compute[71364]:         <nova:port uuid="4bab3701-cae5-4cde-a61d-d4a11308c5bc">
Apr 11 21:51:20 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 21:51:20 user nova-compute[71364]:         </nova:port>
Apr 11 21:51:20 user nova-compute[71364]:         <nova:port uuid="053d127e-a3d3-40dd-92bb-c01cd0580309">
Apr 11 21:51:20 user nova-compute[71364]:           <nova:ip type="fixed" address="10.1.1.25" ipVersion="4"/>
Apr 11 21:51:20 user nova-compute[71364]:         </nova:port>
Apr 11 21:51:20 user nova-compute[71364]:         <nova:port uuid="7ff5ac2a-47b8-4a4e-9391-409086855c84">
Apr 11 21:51:20 user nova-compute[71364]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
Apr 11 21:51:20 user nova-compute[71364]:         </nova:port>
Apr 11 21:51:20 user nova-compute[71364]:         <nova:port uuid="84178c3a-ce1d-40e5-a8df-b01039c2e595">
Apr 11 21:51:20 user nova-compute[71364]:           <nova:ip type="fixed" address="10.1.1.19" ipVersion="4"/>
Apr 11 21:51:20 user nova-compute[71364]:         </nova:port>
Apr 11 21:51:20 user nova-compute[71364]:         <nova:port uuid="b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7">
Apr 11 21:51:20 user nova-compute[71364]:           <nova:ip type="fixed" address="10.1.1.13" ipVersion="4"/>
Apr 11 21:51:20 user nova-compute[71364]:         </nova:port>
Apr 11 21:51:20 user nova-compute[71364]:         <nova:port uuid="2155540f-70ef-4d55-80dd-9f75bcd29afc">
Apr 11 21:51:20 user nova-compute[71364]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 11 21:51:20 user nova-compute[71364]:         </nova:port>
Apr 11 21:51:20 user nova-compute[71364]:         <nova:port uuid="fdc8f7a5-1b0e-4564-a0c7-106abb209b20">
Apr 11 21:51:20 user nova-compute[71364]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 11 21:51:20 user nova-compute[71364]:         </nova:port>
Apr 11 21:51:20 user nova-compute[71364]:       </nova:ports>
Apr 11 21:51:20 user nova-compute[71364]:     </nova:instance>
Apr 11 21:51:20 user nova-compute[71364]:   </metadata>
Apr 11 21:51:20 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:51:20 user nova-compute[71364]:     <system>
Apr 11 21:51:20 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:51:20 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:51:20 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:51:20 user nova-compute[71364]:       <entry name="serial">b38bd805-2d70-441e-8853-73d4e092f4dc</entry>
Apr 11 21:51:20 user nova-compute[71364]:       <entry name="uuid">b38bd805-2d70-441e-8853-73d4e092f4dc</entry>
Apr 11 21:51:20 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:51:20 user nova-compute[71364]:     </system>
Apr 11 21:51:20 user nova-compute[71364]:   </sysinfo>
Apr 11 21:51:20 user nova-compute[71364]:   <os>
Apr 11 21:51:20 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:51:20 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:51:20 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:51:20 user nova-compute[71364]:   </os>
Apr 11 21:51:20 user nova-compute[71364]:   <features>
Apr 11 21:51:20 user nova-compute[71364]:     <acpi/>
Apr 11 21:51:20 user nova-compute[71364]:     <apic/>
Apr 11 21:51:20 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:51:20 user nova-compute[71364]:   </features>
Apr 11 21:51:20 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:51:20 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:51:20 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:51:20 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:51:20 user nova-compute[71364]:   </clock>
Apr 11 21:51:20 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:51:20 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:51:20 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:51:20 user nova-compute[71364]:   </cpu>
Apr 11 21:51:20 user nova-compute[71364]:   <devices>
Apr 11 21:51:20 user nova-compute[71364]:     <disk type="file" device="cdrom">
Apr 11 21:51:20 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 21:51:20 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/b38bd805-2d70-441e-8853-73d4e092f4dc/disk.config"/>
Apr 11 21:51:20 user nova-compute[71364]:       <target dev="hda" bus="ide"/>
Apr 11 21:51:20 user nova-compute[71364]:     </disk>
Apr 11 21:51:20 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 21:51:20 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:51:20 user nova-compute[71364]:       <source dev="/dev/sdb"/>
Apr 11 21:51:20 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:51:20 user nova-compute[71364]:       <serial>fa4d6272-d5c9-4230-bfae-3cc02e26769e</serial>
Apr 11 21:51:20 user nova-compute[71364]:     </disk>
Apr 11 21:51:20 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 21:51:20 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:51:20 user nova-compute[71364]:       <source dev="/dev/sdc"/>
Apr 11 21:51:20 user nova-compute[71364]:       <target dev="vdb" bus="virtio"/>
Apr 11 21:51:20 user nova-compute[71364]:       <serial>88da00ff-62d9-4085-8048-3618f2fea973</serial>
Apr 11 21:51:20 user nova-compute[71364]:     </disk>
Apr 11 21:51:20 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 21:51:20 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:51:20 user nova-compute[71364]:       <source dev="/dev/sdd"/>
Apr 11 21:51:20 user nova-compute[71364]:       <target dev="vdc" bus="virtio"/>
Apr 11 21:51:20 user nova-compute[71364]:       <serial>2ba36538-41e5-4c4a-8b40-4e402df5d540</serial>
Apr 11 21:51:20 user nova-compute[71364]:     </disk>
Apr 11 21:51:20 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:51:20 user nova-compute[71364]:       <mac address="fa:16:3e:08:e9:e5"/>
Apr 11 21:51:20 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:51:20 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:51:20 user nova-compute[71364]:       <target dev="tap4bab3701-ca"/>
Apr 11 21:51:20 user nova-compute[71364]:     </interface>
Apr 11 21:51:20 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:51:20 user nova-compute[71364]:       <mac address="fa:16:3e:fc:20:36"/>
Apr 11 21:51:20 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:51:20 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:51:20 user nova-compute[71364]:       <target dev="tap053d127e-a3"/>
Apr 11 21:51:20 user nova-compute[71364]:     </interface>
Apr 11 21:51:20 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:51:20 user nova-compute[71364]:       <mac address="fa:16:3e:84:11:12"/>
Apr 11 21:51:20 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:51:20 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:51:20 user nova-compute[71364]:       <target dev="tap7ff5ac2a-47"/>
Apr 11 21:51:20 user nova-compute[71364]:     </interface>
Apr 11 21:51:20 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:51:20 user nova-compute[71364]:       <mac address="fa:16:3e:de:5c:a4"/>
Apr 11 21:51:20 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:51:20 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:51:20 user nova-compute[71364]:       <target dev="tap84178c3a-ce"/>
Apr 11 21:51:20 user nova-compute[71364]:     </interface>
Apr 11 21:51:20 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:51:20 user nova-compute[71364]:       <mac address="fa:16:3e:11:2c:22"/>
Apr 11 21:51:20 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:51:20 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:51:20 user nova-compute[71364]:       <target dev="tapb863f6b5-96"/>
Apr 11 21:51:20 user nova-compute[71364]:     </interface>
Apr 11 21:51:20 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:51:20 user nova-compute[71364]:       <mac address="fa:16:3e:5d:35:f8"/>
Apr 11 21:51:20 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:51:20 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:51:20 user nova-compute[71364]:       <target dev="tap2155540f-70"/>
Apr 11 21:51:20 user nova-compute[71364]:     </interface>
Apr 11 21:51:20 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:51:20 user nova-compute[71364]:       <mac address="fa:16:3e:68:6d:d8"/>
Apr 11 21:51:20 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:51:20 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:51:20 user nova-compute[71364]:       <target dev="tapfdc8f7a5-1b"/>
Apr 11 21:51:20 user nova-compute[71364]:     </interface>
Apr 11 21:51:20 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:51:20 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/b38bd805-2d70-441e-8853-73d4e092f4dc/console.log" append="off"/>
Apr 11 21:51:20 user nova-compute[71364]:     </serial>
Apr 11 21:51:20 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:51:20 user nova-compute[71364]:     <video>
Apr 11 21:51:20 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:51:20 user nova-compute[71364]:     </video>
Apr 11 21:51:20 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:51:20 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:51:20 user nova-compute[71364]:     </rng>
Apr 11 21:51:20 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:51:20 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:51:20 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:51:20 user nova-compute[71364]:     </memballoon>
Apr 11 21:51:20 user nova-compute[71364]:   </devices>
Apr 11 21:51:20 user nova-compute[71364]: </domain>
Apr 11 21:51:20 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "address": "fa:16:3e:08:e9:e5", "network": {"id": "fe19ecab-8008-4c75-b42c-893bf768d60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366505631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bab3701-ca", "ovs_interfaceid": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "address": "fa:16:3e:08:e9:e5", "network": {"id": "fe19ecab-8008-4c75-b42c-893bf768d60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366505631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bab3701-ca", "ovs_interfaceid": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=4bab3701-cae5-4cde-a61d-d4a11308c5bc,network=Network(fe19ecab-8008-4c75-b42c-893bf768d60b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bab3701-ca') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG os_vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=4bab3701-cae5-4cde-a61d-d4a11308c5bc,network=Network(fe19ecab-8008-4c75-b42c-893bf768d60b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bab3701-ca') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bab3701-ca, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4bab3701-ca, col_values=(('external_ids', {'iface-id': '4bab3701-cae5-4cde-a61d-d4a11308c5bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:e9:e5', 'vm-uuid': 'b38bd805-2d70-441e-8853-73d4e092f4dc'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: INFO os_vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=4bab3701-cae5-4cde-a61d-d4a11308c5bc,network=Network(fe19ecab-8008-4c75-b42c-893bf768d60b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bab3701-ca')
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "053d127e-a3d3-40dd-92bb-c01cd0580309", "address": "fa:16:3e:fc:20:36", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053d127e-a3", "ovs_interfaceid": "053d127e-a3d3-40dd-92bb-c01cd0580309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "053d127e-a3d3-40dd-92bb-c01cd0580309", "address": "fa:16:3e:fc:20:36", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053d127e-a3", "ovs_interfaceid": "053d127e-a3d3-40dd-92bb-c01cd0580309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:20:36,bridge_name='br-int',has_traffic_filtering=True,id=053d127e-a3d3-40dd-92bb-c01cd0580309,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap053d127e-a3') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG os_vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:20:36,bridge_name='br-int',has_traffic_filtering=True,id=053d127e-a3d3-40dd-92bb-c01cd0580309,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap053d127e-a3') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap053d127e-a3, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap053d127e-a3, col_values=(('external_ids', {'iface-id': '053d127e-a3d3-40dd-92bb-c01cd0580309', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:20:36', 'vm-uuid': 'b38bd805-2d70-441e-8853-73d4e092f4dc'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: INFO os_vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:20:36,bridge_name='br-int',has_traffic_filtering=True,id=053d127e-a3d3-40dd-92bb-c01cd0580309,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap053d127e-a3')
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "address": "fa:16:3e:84:11:12", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5ac2a-47", "ovs_interfaceid": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "address": "fa:16:3e:84:11:12", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5ac2a-47", "ovs_interfaceid": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:11:12,bridge_name='br-int',has_traffic_filtering=True,id=7ff5ac2a-47b8-4a4e-9391-409086855c84,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ff5ac2a-47') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG os_vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:11:12,bridge_name='br-int',has_traffic_filtering=True,id=7ff5ac2a-47b8-4a4e-9391-409086855c84,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ff5ac2a-47') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ff5ac2a-47, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ff5ac2a-47, col_values=(('external_ids', {'iface-id': '7ff5ac2a-47b8-4a4e-9391-409086855c84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:11:12', 'vm-uuid': 'b38bd805-2d70-441e-8853-73d4e092f4dc'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: INFO os_vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:11:12,bridge_name='br-int',has_traffic_filtering=True,id=7ff5ac2a-47b8-4a4e-9391-409086855c84,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ff5ac2a-47')
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "address": "fa:16:3e:de:5c:a4", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84178c3a-ce", "ovs_interfaceid": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "address": "fa:16:3e:de:5c:a4", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84178c3a-ce", "ovs_interfaceid": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:5c:a4,bridge_name='br-int',has_traffic_filtering=True,id=84178c3a-ce1d-40e5-a8df-b01039c2e595,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84178c3a-ce') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG os_vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:5c:a4,bridge_name='br-int',has_traffic_filtering=True,id=84178c3a-ce1d-40e5-a8df-b01039c2e595,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84178c3a-ce') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84178c3a-ce, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84178c3a-ce, col_values=(('external_ids', {'iface-id': '84178c3a-ce1d-40e5-a8df-b01039c2e595', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:5c:a4', 'vm-uuid': 'b38bd805-2d70-441e-8853-73d4e092f4dc'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: INFO os_vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:5c:a4,bridge_name='br-int',has_traffic_filtering=True,id=84178c3a-ce1d-40e5-a8df-b01039c2e595,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84178c3a-ce')
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "address": "fa:16:3e:11:2c:22", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb863f6b5-96", "ovs_interfaceid": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "address": "fa:16:3e:11:2c:22", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb863f6b5-96", "ovs_interfaceid": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:2c:22,bridge_name='br-int',has_traffic_filtering=True,id=b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb863f6b5-96') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG os_vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:2c:22,bridge_name='br-int',has_traffic_filtering=True,id=b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb863f6b5-96') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb863f6b5-96, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb863f6b5-96, col_values=(('external_ids', {'iface-id': 'b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:2c:22', 'vm-uuid': 'b38bd805-2d70-441e-8853-73d4e092f4dc'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:21 user nova-compute[71364]: INFO os_vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:2c:22,bridge_name='br-int',has_traffic_filtering=True,id=b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb863f6b5-96')
Apr 11 21:51:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "address": "fa:16:3e:5d:35:f8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2155540f-70", "ovs_interfaceid": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "address": "fa:16:3e:5d:35:f8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2155540f-70", "ovs_interfaceid": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:35:f8,bridge_name='br-int',has_traffic_filtering=True,id=2155540f-70ef-4d55-80dd-9f75bcd29afc,network=Network(0d00e759-61ae-4b5a-81a5-dda1e2ba7670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2155540f-70') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG os_vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:35:f8,bridge_name='br-int',has_traffic_filtering=True,id=2155540f-70ef-4d55-80dd-9f75bcd29afc,network=Network(0d00e759-61ae-4b5a-81a5-dda1e2ba7670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2155540f-70') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2155540f-70, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2155540f-70, col_values=(('external_ids', {'iface-id': '2155540f-70ef-4d55-80dd-9f75bcd29afc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:35:f8', 'vm-uuid': 'b38bd805-2d70-441e-8853-73d4e092f4dc'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:21 user nova-compute[71364]: INFO os_vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:35:f8,bridge_name='br-int',has_traffic_filtering=True,id=2155540f-70ef-4d55-80dd-9f75bcd29afc,network=Network(0d00e759-61ae-4b5a-81a5-dda1e2ba7670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2155540f-70')
Apr 11 21:51:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "address": "fa:16:3e:68:6d:d8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc8f7a5-1b", "ovs_interfaceid": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "address": "fa:16:3e:68:6d:d8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc8f7a5-1b", "ovs_interfaceid": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:6d:d8,bridge_name='br-int',has_traffic_filtering=True,id=fdc8f7a5-1b0e-4564-a0c7-106abb209b20,network=Network(0d00e759-61ae-4b5a-81a5-dda1e2ba7670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc8f7a5-1b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG os_vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:6d:d8,bridge_name='br-int',has_traffic_filtering=True,id=fdc8f7a5-1b0e-4564-a0c7-106abb209b20,network=Network(0d00e759-61ae-4b5a-81a5-dda1e2ba7670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc8f7a5-1b') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdc8f7a5-1b, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfdc8f7a5-1b, col_values=(('external_ids', {'iface-id': 'fdc8f7a5-1b0e-4564-a0c7-106abb209b20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:6d:d8', 'vm-uuid': 'b38bd805-2d70-441e-8853-73d4e092f4dc'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:21 user nova-compute[71364]: INFO os_vif [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:6d:d8,bridge_name='br-int',has_traffic_filtering=True,id=fdc8f7a5-1b0e-4564-a0c7-106abb209b20,network=Network(0d00e759-61ae-4b5a-81a5-dda1e2ba7670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc8f7a5-1b')
Apr 11 21:51:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] No BDM found with device name hda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] No VIF found with MAC fa:16:3e:08:e9:e5, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] No VIF found with MAC fa:16:3e:11:2c:22, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:51:21 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Using config drive
Apr 11 21:51:21 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Creating config drive at /opt/stack/data/nova/instances/b38bd805-2d70-441e-8853-73d4e092f4dc/disk.config
Apr 11 21:51:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b38bd805-2d70-441e-8853-73d4e092f4dc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0f8231r4 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b38bd805-2d70-441e-8853-73d4e092f4dc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp0f8231r4" returned: 0 in 0.053s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-5d0f5489-b535-4f26-a7ad-bbac6adfffbd req-74a5fe54-9ea3-42ab-a53c-9509b0a5d460 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5d0f5489-b535-4f26-a7ad-bbac6adfffbd req-74a5fe54-9ea3-42ab-a53c-9509b0a5d460 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5d0f5489-b535-4f26-a7ad-bbac6adfffbd req-74a5fe54-9ea3-42ab-a53c-9509b0a5d460 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5d0f5489-b535-4f26-a7ad-bbac6adfffbd req-74a5fe54-9ea3-42ab-a53c-9509b0a5d460 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-5d0f5489-b535-4f26-a7ad-bbac6adfffbd req-74a5fe54-9ea3-42ab-a53c-9509b0a5d460 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:23 user nova-compute[71364]: WARNING nova.compute.manager [req-5d0f5489-b535-4f26-a7ad-bbac6adfffbd req-74a5fe54-9ea3-42ab-a53c-9509b0a5d460 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-4bab3701-cae5-4cde-a61d-d4a11308c5bc for instance with vm_state building and task_state spawning.
Apr 11 21:51:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-ef527061-a32b-4e0e-9dcc-09f849163780 req-4fc78768-b92c-45a1-8983-062190e552a4 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-7ff5ac2a-47b8-4a4e-9391-409086855c84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ef527061-a32b-4e0e-9dcc-09f849163780 req-4fc78768-b92c-45a1-8983-062190e552a4 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ef527061-a32b-4e0e-9dcc-09f849163780 req-4fc78768-b92c-45a1-8983-062190e552a4 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ef527061-a32b-4e0e-9dcc-09f849163780 req-4fc78768-b92c-45a1-8983-062190e552a4 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-ef527061-a32b-4e0e-9dcc-09f849163780 req-4fc78768-b92c-45a1-8983-062190e552a4 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-7ff5ac2a-47b8-4a4e-9391-409086855c84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:24 user nova-compute[71364]: WARNING nova.compute.manager [req-ef527061-a32b-4e0e-9dcc-09f849163780 req-4fc78768-b92c-45a1-8983-062190e552a4 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-7ff5ac2a-47b8-4a4e-9391-409086855c84 for instance with vm_state building and task_state spawning.
Apr 11 21:51:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-400cf67d-f94f-457a-bd0c-7e3a6d2b4f1b req-f58b1a9a-87b3-495b-afe2-ff39ec48364a service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-400cf67d-f94f-457a-bd0c-7e3a6d2b4f1b req-f58b1a9a-87b3-495b-afe2-ff39ec48364a service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-400cf67d-f94f-457a-bd0c-7e3a6d2b4f1b req-f58b1a9a-87b3-495b-afe2-ff39ec48364a service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-400cf67d-f94f-457a-bd0c-7e3a6d2b4f1b req-f58b1a9a-87b3-495b-afe2-ff39ec48364a service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-400cf67d-f94f-457a-bd0c-7e3a6d2b4f1b req-f58b1a9a-87b3-495b-afe2-ff39ec48364a service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:25 user nova-compute[71364]: WARNING nova.compute.manager [req-400cf67d-f94f-457a-bd0c-7e3a6d2b4f1b req-f58b1a9a-87b3-495b-afe2-ff39ec48364a service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 for instance with vm_state building and task_state spawning.
Apr 11 21:51:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:25 user nova-compute[71364]: WARNING nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-4bab3701-cae5-4cde-a61d-d4a11308c5bc for instance with vm_state building and task_state spawning.
Apr 11 21:51:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-053d127e-a3d3-40dd-92bb-c01cd0580309 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-053d127e-a3d3-40dd-92bb-c01cd0580309 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:25 user nova-compute[71364]: WARNING nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-053d127e-a3d3-40dd-92bb-c01cd0580309 for instance with vm_state building and task_state spawning.
Apr 11 21:51:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-053d127e-a3d3-40dd-92bb-c01cd0580309 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-053d127e-a3d3-40dd-92bb-c01cd0580309 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:25 user nova-compute[71364]: WARNING nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-053d127e-a3d3-40dd-92bb-c01cd0580309 for instance with vm_state building and task_state spawning.
Apr 11 21:51:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-84178c3a-ce1d-40e5-a8df-b01039c2e595 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-84178c3a-ce1d-40e5-a8df-b01039c2e595 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:25 user nova-compute[71364]: WARNING nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-84178c3a-ce1d-40e5-a8df-b01039c2e595 for instance with vm_state building and task_state spawning.
Apr 11 21:51:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-84178c3a-ce1d-40e5-a8df-b01039c2e595 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-84178c3a-ce1d-40e5-a8df-b01039c2e595 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:25 user nova-compute[71364]: WARNING nova.compute.manager [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-84178c3a-ce1d-40e5-a8df-b01039c2e595 for instance with vm_state building and task_state spawning.
Apr 11 21:51:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG nova.compute.manager [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-7ff5ac2a-47b8-4a4e-9391-409086855c84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG nova.compute.manager [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-7ff5ac2a-47b8-4a4e-9391-409086855c84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:26 user nova-compute[71364]: WARNING nova.compute.manager [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-7ff5ac2a-47b8-4a4e-9391-409086855c84 for instance with vm_state building and task_state spawning.
Apr 11 21:51:26 user nova-compute[71364]: DEBUG nova.compute.manager [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-2155540f-70ef-4d55-80dd-9f75bcd29afc {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG nova.compute.manager [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-2155540f-70ef-4d55-80dd-9f75bcd29afc {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:26 user nova-compute[71364]: WARNING nova.compute.manager [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-2155540f-70ef-4d55-80dd-9f75bcd29afc for instance with vm_state building and task_state spawning.
Apr 11 21:51:26 user nova-compute[71364]: DEBUG nova.compute.manager [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-2155540f-70ef-4d55-80dd-9f75bcd29afc {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG nova.compute.manager [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-2155540f-70ef-4d55-80dd-9f75bcd29afc {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:26 user nova-compute[71364]: WARNING nova.compute.manager [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-2155540f-70ef-4d55-80dd-9f75bcd29afc for instance with vm_state building and task_state spawning.
Apr 11 21:51:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-944c3e6b-9bf0-4fab-ad13-2f2a2c3ccdb5 req-863542a4-4118-4ea1-bbc1-a1047444efb9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-944c3e6b-9bf0-4fab-ad13-2f2a2c3ccdb5 req-863542a4-4118-4ea1-bbc1-a1047444efb9 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-944c3e6b-9bf0-4fab-ad13-2f2a2c3ccdb5 req-863542a4-4118-4ea1-bbc1-a1047444efb9 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-944c3e6b-9bf0-4fab-ad13-2f2a2c3ccdb5 req-863542a4-4118-4ea1-bbc1-a1047444efb9 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-944c3e6b-9bf0-4fab-ad13-2f2a2c3ccdb5 req-863542a4-4118-4ea1-bbc1-a1047444efb9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:27 user nova-compute[71364]: WARNING nova.compute.manager [req-944c3e6b-9bf0-4fab-ad13-2f2a2c3ccdb5 req-863542a4-4118-4ea1-bbc1-a1047444efb9 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 for instance with vm_state building and task_state spawning.
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249887.6208358, b38bd805-2d70-441e-8853-73d4e092f4dc => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:51:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] VM Resumed (Lifecycle Event)
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-fdc8f7a5-1b0e-4564-a0c7-106abb209b20 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-fdc8f7a5-1b0e-4564-a0c7-106abb209b20 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:27 user nova-compute[71364]: WARNING nova.compute.manager [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-fdc8f7a5-1b0e-4564-a0c7-106abb209b20 for instance with vm_state building and task_state spawning.
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-fdc8f7a5-1b0e-4564-a0c7-106abb209b20 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-fdc8f7a5-1b0e-4564-a0c7-106abb209b20 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:27 user nova-compute[71364]: WARNING nova.compute.manager [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-fdc8f7a5-1b0e-4564-a0c7-106abb209b20 for instance with vm_state building and task_state spawning.
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:51:27 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Instance spawned successfully.
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:51:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249887.622798, b38bd805-2d70-441e-8853-73d4e092f4dc => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:51:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] VM Started (Lifecycle Event)
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:51:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:51:27 user nova-compute[71364]: INFO nova.compute.manager [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Took 11.15 seconds to spawn the instance on the hypervisor.
Apr 11 21:51:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:51:27 user nova-compute[71364]: INFO nova.compute.manager [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Took 27.39 seconds to build instance.
Apr 11 21:51:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.492s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "d9341aca-d5c9-4c23-b8de-adb5360721bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "d9341aca-d5c9-4c23-b8de-adb5360721bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:51:48 user nova-compute[71364]: INFO nova.compute.claims [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Claim successful on node user
Apr 11 21:51:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG nova.network.neutron [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:51:48 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:51:48 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG nova.policy [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '839497b8586f4d9c8cc849e1de31c0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db880c2bdad74479a85e926c37352962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:51:48 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Creating image(s)
Apr 11 21:51:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "/opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "/opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:51:48 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.147s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-13124f93-665b-4107-bd71-16674bdb9a64" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-13124f93-665b-4107-bd71-16674bdb9a64" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/disk 1073741824" returned: 0 in 0.049s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG nova.network.neutron [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Successfully created port: 22ba4180-8733-488d-93d4-71b404970953 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Cannot resize image /opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lazy-loading 'migration_context' on Instance uuid d9341aca-d5c9-4c23-b8de-adb5360721bf {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Ensure instance console log exists: /opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Updating instance_info_cache with network_info: [{"id": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "address": "fa:16:3e:0d:61:f9", "network": {"id": "93e24ee9-e650-404a-8b5d-680ca2e1e132", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1215474541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93062d2dda5548e5b9a7dabe2f69b094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4da68e-e9", "ovs_interfaceid": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-13124f93-665b-4107-bd71-16674bdb9a64" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:51:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG nova.network.neutron [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Successfully updated port: 22ba4180-8733-488d-93d4-71b404970953 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-8b2defbb-6963-4ad2-b705-ccb5c13feef2 req-bbba633d-4d94-4e91-9722-4fdf0d65e597 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Received event network-changed-22ba4180-8733-488d-93d4-71b404970953 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-8b2defbb-6963-4ad2-b705-ccb5c13feef2 req-bbba633d-4d94-4e91-9722-4fdf0d65e597 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Refreshing instance network info cache due to event network-changed-22ba4180-8733-488d-93d4-71b404970953. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8b2defbb-6963-4ad2-b705-ccb5c13feef2 req-bbba633d-4d94-4e91-9722-4fdf0d65e597 service nova] Acquiring lock "refresh_cache-d9341aca-d5c9-4c23-b8de-adb5360721bf" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8b2defbb-6963-4ad2-b705-ccb5c13feef2 req-bbba633d-4d94-4e91-9722-4fdf0d65e597 service nova] Acquired lock "refresh_cache-d9341aca-d5c9-4c23-b8de-adb5360721bf" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG nova.network.neutron [req-8b2defbb-6963-4ad2-b705-ccb5c13feef2 req-bbba633d-4d94-4e91-9722-4fdf0d65e597 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Refreshing network info cache for port 22ba4180-8733-488d-93d4-71b404970953 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "refresh_cache-d9341aca-d5c9-4c23-b8de-adb5360721bf" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG nova.network.neutron [req-8b2defbb-6963-4ad2-b705-ccb5c13feef2 req-bbba633d-4d94-4e91-9722-4fdf0d65e597 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG nova.network.neutron [req-8b2defbb-6963-4ad2-b705-ccb5c13feef2 req-bbba633d-4d94-4e91-9722-4fdf0d65e597 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8b2defbb-6963-4ad2-b705-ccb5c13feef2 req-bbba633d-4d94-4e91-9722-4fdf0d65e597 service nova] Releasing lock "refresh_cache-d9341aca-d5c9-4c23-b8de-adb5360721bf" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquired lock "refresh_cache-d9341aca-d5c9-4c23-b8de-adb5360721bf" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG nova.network.neutron [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG nova.network.neutron [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.network.neutron [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Updating instance_info_cache with network_info: [{"id": "22ba4180-8733-488d-93d4-71b404970953", "address": "fa:16:3e:ac:f9:06", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ba4180-87", "ovs_interfaceid": "22ba4180-8733-488d-93d4-71b404970953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Releasing lock "refresh_cache-d9341aca-d5c9-4c23-b8de-adb5360721bf" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Instance network_info: |[{"id": "22ba4180-8733-488d-93d4-71b404970953", "address": "fa:16:3e:ac:f9:06", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ba4180-87", "ovs_interfaceid": "22ba4180-8733-488d-93d4-71b404970953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Start _get_guest_xml network_info=[{"id": "22ba4180-8733-488d-93d4-71b404970953", "address": "fa:16:3e:ac:f9:06", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ba4180-87", "ovs_interfaceid": "22ba4180-8733-488d-93d4-71b404970953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:51 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:51:51 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-640184675',display_name='tempest-ServersNegativeTestJSON-server-640184675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-640184675',id=11,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db880c2bdad74479a85e926c37352962',ramdisk_id='',reservation_id='r-5p0bfdmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-46827538',owner_user_name='tempest-ServersNegativeTestJSON-46827538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:49Z,user_data=None,user_id='839497b8586f4d9c8cc849e1de31c0e9',uuid=d9341aca-d5c9-4c23-b8de-adb5360721bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22ba4180-8733-488d-93d4-71b404970953", "address": "fa:16:3e:ac:f9:06", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ba4180-87", "ovs_interfaceid": "22ba4180-8733-488d-93d4-71b404970953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Converting VIF {"id": "22ba4180-8733-488d-93d4-71b404970953", "address": "fa:16:3e:ac:f9:06", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ba4180-87", "ovs_interfaceid": "22ba4180-8733-488d-93d4-71b404970953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:f9:06,bridge_name='br-int',has_traffic_filtering=True,id=22ba4180-8733-488d-93d4-71b404970953,network=Network(e7c6d356-dca6-4d85-ac96-dc14b5e5993d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ba4180-87') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lazy-loading 'pci_devices' on Instance uuid d9341aca-d5c9-4c23-b8de-adb5360721bf {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:51:51 user nova-compute[71364]:   <uuid>d9341aca-d5c9-4c23-b8de-adb5360721bf</uuid>
Apr 11 21:51:51 user nova-compute[71364]:   <name>instance-0000000b</name>
Apr 11 21:51:51 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:51:51 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:51:51 user nova-compute[71364]:   <metadata>
Apr 11 21:51:51 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:51:51 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:51:51 user nova-compute[71364]:       <nova:name>tempest-ServersNegativeTestJSON-server-640184675</nova:name>
Apr 11 21:51:51 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:51:51</nova:creationTime>
Apr 11 21:51:51 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:51:51 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:51:51 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:51:51 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:51:51 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:51:51 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:51:51 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:51:51 user nova-compute[71364]:       <nova:owner>
Apr 11 21:51:51 user nova-compute[71364]:         <nova:user uuid="839497b8586f4d9c8cc849e1de31c0e9">tempest-ServersNegativeTestJSON-46827538-project-member</nova:user>
Apr 11 21:51:51 user nova-compute[71364]:         <nova:project uuid="db880c2bdad74479a85e926c37352962">tempest-ServersNegativeTestJSON-46827538</nova:project>
Apr 11 21:51:51 user nova-compute[71364]:       </nova:owner>
Apr 11 21:51:51 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:51:51 user nova-compute[71364]:       <nova:ports>
Apr 11 21:51:51 user nova-compute[71364]:         <nova:port uuid="22ba4180-8733-488d-93d4-71b404970953">
Apr 11 21:51:51 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 21:51:51 user nova-compute[71364]:         </nova:port>
Apr 11 21:51:51 user nova-compute[71364]:       </nova:ports>
Apr 11 21:51:51 user nova-compute[71364]:     </nova:instance>
Apr 11 21:51:51 user nova-compute[71364]:   </metadata>
Apr 11 21:51:51 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:51:51 user nova-compute[71364]:     <system>
Apr 11 21:51:51 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:51:51 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:51:51 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:51:51 user nova-compute[71364]:       <entry name="serial">d9341aca-d5c9-4c23-b8de-adb5360721bf</entry>
Apr 11 21:51:51 user nova-compute[71364]:       <entry name="uuid">d9341aca-d5c9-4c23-b8de-adb5360721bf</entry>
Apr 11 21:51:51 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:51:51 user nova-compute[71364]:     </system>
Apr 11 21:51:51 user nova-compute[71364]:   </sysinfo>
Apr 11 21:51:51 user nova-compute[71364]:   <os>
Apr 11 21:51:51 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:51:51 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:51:51 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:51:51 user nova-compute[71364]:   </os>
Apr 11 21:51:51 user nova-compute[71364]:   <features>
Apr 11 21:51:51 user nova-compute[71364]:     <acpi/>
Apr 11 21:51:51 user nova-compute[71364]:     <apic/>
Apr 11 21:51:51 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:51:51 user nova-compute[71364]:   </features>
Apr 11 21:51:51 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:51:51 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:51:51 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:51:51 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:51:51 user nova-compute[71364]:   </clock>
Apr 11 21:51:51 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:51:51 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:51:51 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:51:51 user nova-compute[71364]:   </cpu>
Apr 11 21:51:51 user nova-compute[71364]:   <devices>
Apr 11 21:51:51 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:51:51 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:51:51 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/disk"/>
Apr 11 21:51:51 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:51:51 user nova-compute[71364]:     </disk>
Apr 11 21:51:51 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:51:51 user nova-compute[71364]:       <mac address="fa:16:3e:ac:f9:06"/>
Apr 11 21:51:51 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:51:51 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:51:51 user nova-compute[71364]:       <target dev="tap22ba4180-87"/>
Apr 11 21:51:51 user nova-compute[71364]:     </interface>
Apr 11 21:51:51 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:51:51 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/console.log" append="off"/>
Apr 11 21:51:51 user nova-compute[71364]:     </serial>
Apr 11 21:51:51 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:51:51 user nova-compute[71364]:     <video>
Apr 11 21:51:51 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:51:51 user nova-compute[71364]:     </video>
Apr 11 21:51:51 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:51:51 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:51:51 user nova-compute[71364]:     </rng>
Apr 11 21:51:51 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:51:51 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:51:51 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:51:51 user nova-compute[71364]:     </memballoon>
Apr 11 21:51:51 user nova-compute[71364]:   </devices>
Apr 11 21:51:51 user nova-compute[71364]: </domain>
Apr 11 21:51:51 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-640184675',display_name='tempest-ServersNegativeTestJSON-server-640184675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-640184675',id=11,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db880c2bdad74479a85e926c37352962',ramdisk_id='',reservation_id='r-5p0bfdmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-46827538',owner_user_name='tempest-ServersNegativeTestJSON-46827538-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:51:49Z,user_data=None,user_id='839497b8586f4d9c8cc849e1de31c0e9',uuid=d9341aca-d5c9-4c23-b8de-adb5360721bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22ba4180-8733-488d-93d4-71b404970953", "address": "fa:16:3e:ac:f9:06", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ba4180-87", "ovs_interfaceid": "22ba4180-8733-488d-93d4-71b404970953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Converting VIF {"id": "22ba4180-8733-488d-93d4-71b404970953", "address": "fa:16:3e:ac:f9:06", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ba4180-87", "ovs_interfaceid": "22ba4180-8733-488d-93d4-71b404970953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:f9:06,bridge_name='br-int',has_traffic_filtering=True,id=22ba4180-8733-488d-93d4-71b404970953,network=Network(e7c6d356-dca6-4d85-ac96-dc14b5e5993d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ba4180-87') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG os_vif [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:f9:06,bridge_name='br-int',has_traffic_filtering=True,id=22ba4180-8733-488d-93d4-71b404970953,network=Network(e7c6d356-dca6-4d85-ac96-dc14b5e5993d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ba4180-87') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22ba4180-87, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22ba4180-87, col_values=(('external_ids', {'iface-id': '22ba4180-8733-488d-93d4-71b404970953', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:f9:06', 'vm-uuid': 'd9341aca-d5c9-4c23-b8de-adb5360721bf'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:51 user nova-compute[71364]: INFO os_vif [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:f9:06,bridge_name='br-int',has_traffic_filtering=True,id=22ba4180-8733-488d-93d4-71b404970953,network=Network(e7c6d356-dca6-4d85-ac96-dc14b5e5993d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ba4180-87')
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] No VIF found with MAC fa:16:3e:ac:f9:06, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "13124f93-665b-4107-bd71-16674bdb9a64" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "13124f93-665b-4107-bd71-16674bdb9a64" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lazy-loading 'flavor' on Instance uuid 13124f93-665b-4107-bd71-16674bdb9a64 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "13124f93-665b-4107-bd71-16674bdb9a64" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.121s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:51:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "13124f93-665b-4107-bd71-16674bdb9a64" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "13124f93-665b-4107-bd71-16674bdb9a64" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:52 user nova-compute[71364]: INFO nova.compute.manager [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Attaching volume db5f2414-2015-4f49-9f40-d5214fb67b70 to /dev/vdb
Apr 11 21:51:52 user nova-compute[71364]: DEBUG os_brick.utils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dbb240-1ee6-46bb-915a-404e1684f20e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed3197d-92fb-44ea-9586-dfe3adba5546]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49cb04b-6423-4f4a-acb1-952ba364eb34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c1317d-ca19-4d07-aa00-1e8d187c247e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:51:52 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f83cfc-2893-47e9-a2c1-c36f44eb8dec]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG os_brick.utils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Updating existing volume attachment record: 293b7d67-d014-4fee-90a4-0820d05c4651 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-eaed1734-5d25-4cb6-9f3c-643a487e843f req-1a51da10-4551-433c-a0a0-6e7d71c41432 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Received event network-vif-plugged-22ba4180-8733-488d-93d4-71b404970953 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-eaed1734-5d25-4cb6-9f3c-643a487e843f req-1a51da10-4551-433c-a0a0-6e7d71c41432 service nova] Acquiring lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-eaed1734-5d25-4cb6-9f3c-643a487e843f req-1a51da10-4551-433c-a0a0-6e7d71c41432 service nova] Lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-eaed1734-5d25-4cb6-9f3c-643a487e843f req-1a51da10-4551-433c-a0a0-6e7d71c41432 service nova] Lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-eaed1734-5d25-4cb6-9f3c-643a487e843f req-1a51da10-4551-433c-a0a0-6e7d71c41432 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] No waiting events found dispatching network-vif-plugged-22ba4180-8733-488d-93d4-71b404970953 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:53 user nova-compute[71364]: WARNING nova.compute.manager [req-eaed1734-5d25-4cb6-9f3c-643a487e843f req-1a51da10-4551-433c-a0a0-6e7d71c41432 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Received unexpected event network-vif-plugged-22ba4180-8733-488d-93d4-71b404970953 for instance with vm_state building and task_state spawning.
Apr 11 21:51:53 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:51:53 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7562MB free_disk=26.478557586669922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b38bd805-2d70-441e-8853-73d4e092f4dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 13124f93-665b-4107-bd71-16674bdb9a64 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance e627de16-3a8f-4510-8001-0e57a272b859 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76315af2-c4b9-4ad5-98ea-81826524d63e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5a3b5455-983c-4c30-b229-8922443af209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 335d5305-28e6-4766-b0b2-b56848ff8652 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d9341aca-d5c9-4c23-b8de-adb5360721bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-fa41c7bb-b785-4ba1-aee5-ec284c887dba req-6c03e4d6-4418-484e-8777-c2d14978d0a7 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-changed-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-fa41c7bb-b785-4ba1-aee5-ec284c887dba req-6c03e4d6-4418-484e-8777-c2d14978d0a7 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Refreshing instance network info cache due to event network-changed-20b9e448-55b1-49a6-8c39-08b2ab9755eb. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fa41c7bb-b785-4ba1-aee5-ec284c887dba req-6c03e4d6-4418-484e-8777-c2d14978d0a7 service nova] Acquiring lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fa41c7bb-b785-4ba1-aee5-ec284c887dba req-6c03e4d6-4418-484e-8777-c2d14978d0a7 service nova] Acquired lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:53 user nova-compute[71364]: DEBUG nova.network.neutron [req-fa41c7bb-b785-4ba1-aee5-ec284c887dba req-6c03e4d6-4418-484e-8777-c2d14978d0a7 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Refreshing network info cache for port 20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.network.neutron [req-fa41c7bb-b785-4ba1-aee5-ec284c887dba req-6c03e4d6-4418-484e-8777-c2d14978d0a7 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updated VIF entry in instance network info cache for port 20b9e448-55b1-49a6-8c39-08b2ab9755eb. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.network.neutron [req-fa41c7bb-b785-4ba1-aee5-ec284c887dba req-6c03e4d6-4418-484e-8777-c2d14978d0a7 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updating instance_info_cache with network_info: [{"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fa41c7bb-b785-4ba1-aee5-ec284c887dba req-6c03e4d6-4418-484e-8777-c2d14978d0a7 service nova] Releasing lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249914.8740711, d9341aca-d5c9-4c23-b8de-adb5360721bf => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:51:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] VM Resumed (Lifecycle Event)
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:51:54 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Instance spawned successfully.
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:51:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681249914.877514, d9341aca-d5c9-4c23-b8de-adb5360721bf => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:51:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] VM Started (Lifecycle Event)
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-1faebaa5-a2e8-4928-9f98-ee26d174493a req-83ee2688-56d3-488a-8bfb-015ccc85f9a7 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Received event network-vif-plugged-22ba4180-8733-488d-93d4-71b404970953 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1faebaa5-a2e8-4928-9f98-ee26d174493a req-83ee2688-56d3-488a-8bfb-015ccc85f9a7 service nova] Acquiring lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1faebaa5-a2e8-4928-9f98-ee26d174493a req-83ee2688-56d3-488a-8bfb-015ccc85f9a7 service nova] Lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1faebaa5-a2e8-4928-9f98-ee26d174493a req-83ee2688-56d3-488a-8bfb-015ccc85f9a7 service nova] Lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-1faebaa5-a2e8-4928-9f98-ee26d174493a req-83ee2688-56d3-488a-8bfb-015ccc85f9a7 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] No waiting events found dispatching network-vif-plugged-22ba4180-8733-488d-93d4-71b404970953 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:51:54 user nova-compute[71364]: WARNING nova.compute.manager [req-1faebaa5-a2e8-4928-9f98-ee26d174493a req-83ee2688-56d3-488a-8bfb-015ccc85f9a7 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Received unexpected event network-vif-plugged-22ba4180-8733-488d-93d4-71b404970953 for instance with vm_state building and task_state spawning.
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:51:54 user nova-compute[71364]: INFO nova.compute.manager [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Took 6.05 seconds to spawn the instance on the hypervisor.
Apr 11 21:51:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:51:55 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:51:55 user nova-compute[71364]: INFO nova.compute.manager [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Took 6.83 seconds to build instance.
Apr 11 21:51:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "d9341aca-d5c9-4c23-b8de-adb5360721bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.926s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:51:55 user nova-compute[71364]: DEBUG nova.compute.manager [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:51:55 user nova-compute[71364]: DEBUG nova.compute.manager [req-76a76ff9-0c64-444b-a074-8465c2731375 req-ac41d070-4b5c-4b0a-9b2e-4b3164334935 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-changed-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:51:55 user nova-compute[71364]: DEBUG nova.compute.manager [req-76a76ff9-0c64-444b-a074-8465c2731375 req-ac41d070-4b5c-4b0a-9b2e-4b3164334935 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Refreshing instance network info cache due to event network-changed-6144f13d-b463-46ef-b75b-d2d982198b72. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:51:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-76a76ff9-0c64-444b-a074-8465c2731375 req-ac41d070-4b5c-4b0a-9b2e-4b3164334935 service nova] Acquiring lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:51:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-76a76ff9-0c64-444b-a074-8465c2731375 req-ac41d070-4b5c-4b0a-9b2e-4b3164334935 service nova] Acquired lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:51:55 user nova-compute[71364]: DEBUG nova.network.neutron [req-76a76ff9-0c64-444b-a074-8465c2731375 req-ac41d070-4b5c-4b0a-9b2e-4b3164334935 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Refreshing network info cache for port 6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:51:55 user nova-compute[71364]: INFO nova.compute.manager [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] instance snapshotting
Apr 11 21:51:55 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Beginning live snapshot process
Apr 11 21:51:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json -f qcow2 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json -f qcow2 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.244s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppbiu9yxz/e00da755a6394e1b90bdf2ded7eb5878.delta 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppbiu9yxz/e00da755a6394e1b90bdf2ded7eb5878.delta 1073741824" returned: 0 in 0.053s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:56 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 21:51:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71364) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 11 21:51:56 user nova-compute[71364]: INFO nova.virt.libvirt.host [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] UEFI support detected
Apr 11 21:51:56 user nova-compute[71364]: DEBUG nova.network.neutron [req-76a76ff9-0c64-444b-a074-8465c2731375 req-ac41d070-4b5c-4b0a-9b2e-4b3164334935 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updated VIF entry in instance network info cache for port 6144f13d-b463-46ef-b75b-d2d982198b72. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG nova.network.neutron [req-76a76ff9-0c64-444b-a074-8465c2731375 req-ac41d070-4b5c-4b0a-9b2e-4b3164334935 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating instance_info_cache with network_info: [{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-76a76ff9-0c64-444b-a074-8465c2731375 req-ac41d070-4b5c-4b0a-9b2e-4b3164334935 service nova] Releasing lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpLUaBrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:51:56 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:51:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:51:56 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:51:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:51:56 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad8ffdd-de8e-429a-bfd9-74ec8b13efb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:51:56 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58de511-7150-4cbb-aa6f-7b66fe3e8b72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70] added
Apr 11 21:51:56 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a9b84a-0176-42cd-a016-ff9309a6730c]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d8640e-103d-43e5-9952-a7214bf69a1b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FpLUaBrO {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FpLUaBrO" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acc7d38-a1c0-4c3b-9fc3-bc58cc06cbb0]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FpLUaBrO'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c3fe79-c695-4f04-9ec0-85210ad2043a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[df74150f-dd99-4592-96fb-9d230029dd79]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:51:56 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:51:56 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:51:56 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:51:56 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:51:56 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:51:56 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:51:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3e52e8-a0cf-45ab-88a5-008ac85090ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70, portal: 172.16.0.220,3260]
Apr 11 21:51:57 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70, portal: 172.16.0.220,3260] successful.
Apr 11 21:51:57 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.103s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8ba04d-9804-498e-8928-6f93dff1bb59]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[131bf811-a202-4f91-811c-cf42c31eaaa9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:51:57 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:51:57 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:51:57 user nova-compute[71364]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 (non-flash)
Apr 11 21:51:57 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:51:57 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:51:57 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:51:57 user nova-compute[71364]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 (non-flash)
Apr 11 21:51:57 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a0d4c9-21ca-487b-84df-1416b7bec754]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpLUaBrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:51:57 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 21:51:57 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppbiu9yxz/e00da755a6394e1b90bdf2ded7eb5878.delta /opt/stack/data/nova/instances/snapshots/tmppbiu9yxz/e00da755a6394e1b90bdf2ded7eb5878 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:51:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppbiu9yxz/e00da755a6394e1b90bdf2ded7eb5878.delta /opt/stack/data/nova/instances/snapshots/tmppbiu9yxz/e00da755a6394e1b90bdf2ded7eb5878" returned: 0 in 0.190s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:51:57 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Snapshot extracted, beginning image upload
Apr 11 21:51:58 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:51:58 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '26262353764336537', 'path': '/dev/sde'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:51:58 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262353764336537', 'path': '/dev/sde'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:51:58 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lazy-loading 'flavor' on Instance uuid 13124f93-665b-4107-bd71-16674bdb9a64 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:51:58 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:51:58 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:51:58 user nova-compute[71364]:   <source dev="/dev/sde"/>
Apr 11 21:51:58 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:51:58 user nova-compute[71364]:   <serial>db5f2414-2015-4f49-9f40-d5214fb67b70</serial>
Apr 11 21:51:58 user nova-compute[71364]: </disk>
Apr 11 21:51:58 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:51:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:51:58 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:51:58 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:51:58 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] No VIF found with MAC fa:16:3e:0d:61:f9, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:51:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "13124f93-665b-4107-bd71-16674bdb9a64" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.614s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "13124f93-665b-4107-bd71-16674bdb9a64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "13124f93-665b-4107-bd71-16674bdb9a64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "13124f93-665b-4107-bd71-16674bdb9a64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "13124f93-665b-4107-bd71-16674bdb9a64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "13124f93-665b-4107-bd71-16674bdb9a64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:00 user nova-compute[71364]: INFO nova.compute.manager [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Terminating instance
Apr 11 21:52:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG nova.compute.manager [req-427fb4f1-e9d3-4ab7-901c-47b257a2c98a req-107869ed-4add-4e2b-ad8b-9477e131e007 service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Received event network-vif-unplugged-9e4da68e-e9a4-4d29-b326-bc52cad55a93 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-427fb4f1-e9d3-4ab7-901c-47b257a2c98a req-107869ed-4add-4e2b-ad8b-9477e131e007 service nova] Acquiring lock "13124f93-665b-4107-bd71-16674bdb9a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-427fb4f1-e9d3-4ab7-901c-47b257a2c98a req-107869ed-4add-4e2b-ad8b-9477e131e007 service nova] Lock "13124f93-665b-4107-bd71-16674bdb9a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-427fb4f1-e9d3-4ab7-901c-47b257a2c98a req-107869ed-4add-4e2b-ad8b-9477e131e007 service nova] Lock "13124f93-665b-4107-bd71-16674bdb9a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG nova.compute.manager [req-427fb4f1-e9d3-4ab7-901c-47b257a2c98a req-107869ed-4add-4e2b-ad8b-9477e131e007 service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] No waiting events found dispatching network-vif-unplugged-9e4da68e-e9a4-4d29-b326-bc52cad55a93 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG nova.compute.manager [req-427fb4f1-e9d3-4ab7-901c-47b257a2c98a req-107869ed-4add-4e2b-ad8b-9477e131e007 service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Received event network-vif-unplugged-9e4da68e-e9a4-4d29-b326-bc52cad55a93 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:52:00 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Snapshot image upload complete
Apr 11 21:52:00 user nova-compute[71364]: INFO nova.compute.manager [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Took 5.15 seconds to snapshot the instance on the hypervisor.
Apr 11 21:52:00 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Instance destroyed successfully.
Apr 11 21:52:00 user nova-compute[71364]: DEBUG nova.objects.instance [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lazy-loading 'resources' on Instance uuid 13124f93-665b-4107-bd71-16674bdb9a64 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:49:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-789334926',display_name='tempest-DeleteServersTestJSON-server-789334926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-789334926',id=2,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93062d2dda5548e5b9a7dabe2f69b094',ramdisk_id='',reservation_id='r-tcu7akj4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-141105202',owner_user_name='tempest-DeleteServersTestJSON-141105202-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:50:15Z,user_data=None,user_id='6660fbfd58b54271b92500f76759f362',uuid=13124f93-665b-4107-bd71-16674bdb9a64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "address": "fa:16:3e:0d:61:f9", "network": {"id": "93e24ee9-e650-404a-8b5d-680ca2e1e132", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1215474541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93062d2dda5548e5b9a7dabe2f69b094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4da68e-e9", "ovs_interfaceid": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Converting VIF {"id": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "address": "fa:16:3e:0d:61:f9", "network": {"id": "93e24ee9-e650-404a-8b5d-680ca2e1e132", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1215474541-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93062d2dda5548e5b9a7dabe2f69b094", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e4da68e-e9", "ovs_interfaceid": "9e4da68e-e9a4-4d29-b326-bc52cad55a93", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:61:f9,bridge_name='br-int',has_traffic_filtering=True,id=9e4da68e-e9a4-4d29-b326-bc52cad55a93,network=Network(93e24ee9-e650-404a-8b5d-680ca2e1e132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4da68e-e9') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG os_vif [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:61:f9,bridge_name='br-int',has_traffic_filtering=True,id=9e4da68e-e9a4-4d29-b326-bc52cad55a93,network=Network(93e24ee9-e650-404a-8b5d-680ca2e1e132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4da68e-e9') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e4da68e-e9, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:52:00 user nova-compute[71364]: INFO os_vif [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:61:f9,bridge_name='br-int',has_traffic_filtering=True,id=9e4da68e-e9a4-4d29-b326-bc52cad55a93,network=Network(93e24ee9-e650-404a-8b5d-680ca2e1e132),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e4da68e-e9')
Apr 11 21:52:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FpLUaBrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:00 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73cb0ee-20fd-45c0-b3ff-af12b7d8279f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:52:00 user nova-compute[71364]: No targets found.
Apr 11 21:52:00 user nova-compute[71364]: iSNS:
Apr 11 21:52:00 user nova-compute[71364]: No targets found.
Apr 11 21:52:00 user nova-compute[71364]: STATIC:
Apr 11 21:52:00 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540
Apr 11 21:52:00 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:00 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:00 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e
Apr 11 21:52:00 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:00 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:00 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70
Apr 11 21:52:00 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:00 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:00 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973
Apr 11 21:52:00 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:00 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:00 user nova-compute[71364]: FIRMWARE:
Apr 11 21:52:00 user nova-compute[71364]: No targets found.
Apr 11 21:52:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:52:00 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:52:00 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[931a92df-9161-471f-a42a-1540b7e619f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7749f4e-7a84-435f-8f5a-47f25b353ac0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:01 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:01 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:01 user nova-compute[71364]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 (non-flash)
Apr 11 21:52:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:01 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:01 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:01 user nova-compute[71364]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 (non-flash)
Apr 11 21:52:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacff37f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70'): ({'sde'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Removing single pathed devices sde {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b6c66a-2318-496f-963a-8cbaa7964f76]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[124694f5-5a7d-4a79-978a-a26afc1d775d]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Flushing IO for device /dev/sde {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bcb5d1-08f9-42d3-8434-18584a7375e7]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb0fcec-296c-4e80-ab85-82fcff02634f]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a02d9a-3027-4d5c-979b-58eea2b38e1e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36fd651-d5c2-4698-91ad-ce62a40c330f]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70, portal: 172.16.0.220,3260]
Apr 11 21:52:01 user nova-compute[71364]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db5f2414-2015-4f49-9f40-d5214fb67b70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bb5c2e-b0a4-4bae-9e8c-8a8fffdefc16]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] <== disconnect_volume: return (342ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:52:01 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Deleting instance files /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64_del
Apr 11 21:52:01 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Deletion of /opt/stack/data/nova/instances/13124f93-665b-4107-bd71-16674bdb9a64_del complete
Apr 11 21:52:01 user nova-compute[71364]: INFO nova.compute.manager [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Took 1.28 seconds to destroy the instance on the hypervisor.
Apr 11 21:52:01 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:52:01 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:52:02 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Took 0.81 seconds to deallocate network for instance.
Apr 11 21:52:02 user nova-compute[71364]: DEBUG nova.compute.manager [req-0c48861f-04d9-4982-b9be-220d4d9f494f req-9c5a4c00-cc53-4cb9-9ba7-b2c6cb19c38f service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Received event network-vif-plugged-9e4da68e-e9a4-4d29-b326-bc52cad55a93 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0c48861f-04d9-4982-b9be-220d4d9f494f req-9c5a4c00-cc53-4cb9-9ba7-b2c6cb19c38f service nova] Acquiring lock "13124f93-665b-4107-bd71-16674bdb9a64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0c48861f-04d9-4982-b9be-220d4d9f494f req-9c5a4c00-cc53-4cb9-9ba7-b2c6cb19c38f service nova] Lock "13124f93-665b-4107-bd71-16674bdb9a64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0c48861f-04d9-4982-b9be-220d4d9f494f req-9c5a4c00-cc53-4cb9-9ba7-b2c6cb19c38f service nova] Lock "13124f93-665b-4107-bd71-16674bdb9a64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:02 user nova-compute[71364]: DEBUG nova.compute.manager [req-0c48861f-04d9-4982-b9be-220d4d9f494f req-9c5a4c00-cc53-4cb9-9ba7-b2c6cb19c38f service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] No waiting events found dispatching network-vif-plugged-9e4da68e-e9a4-4d29-b326-bc52cad55a93 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:02 user nova-compute[71364]: WARNING nova.compute.manager [req-0c48861f-04d9-4982-b9be-220d4d9f494f req-9c5a4c00-cc53-4cb9-9ba7-b2c6cb19c38f service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Received unexpected event network-vif-plugged-9e4da68e-e9a4-4d29-b326-bc52cad55a93 for instance with vm_state active and task_state deleting.
Apr 11 21:52:02 user nova-compute[71364]: DEBUG nova.compute.manager [req-0c48861f-04d9-4982-b9be-220d4d9f494f req-9c5a4c00-cc53-4cb9-9ba7-b2c6cb19c38f service nova] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Received event network-vif-deleted-9e4da68e-e9a4-4d29-b326-bc52cad55a93 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:02 user nova-compute[71364]: INFO nova.compute.manager [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Took 0.81 seconds to detach 1 volumes for instance.
Apr 11 21:52:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:03 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:52:03 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:52:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:03 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Deleted allocations for instance 13124f93-665b-4107-bd71-16674bdb9a64
Apr 11 21:52:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "13124f93-665b-4107-bd71-16674bdb9a64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.413s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:12 user nova-compute[71364]: DEBUG nova.compute.manager [req-56835ba9-c4fc-4697-8d48-22eafda56e76 req-e4a0bab6-9773-46c7-b0f6-7c0d178a39f3 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Received event network-changed-327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:12 user nova-compute[71364]: DEBUG nova.compute.manager [req-56835ba9-c4fc-4697-8d48-22eafda56e76 req-e4a0bab6-9773-46c7-b0f6-7c0d178a39f3 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Refreshing instance network info cache due to event network-changed-327f645b-e31b-4f09-88d2-a53f8a29905c. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:52:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-56835ba9-c4fc-4697-8d48-22eafda56e76 req-e4a0bab6-9773-46c7-b0f6-7c0d178a39f3 service nova] Acquiring lock "refresh_cache-f279b153-a1c9-46f5-a0c5-4574ab956ba8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:52:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-56835ba9-c4fc-4697-8d48-22eafda56e76 req-e4a0bab6-9773-46c7-b0f6-7c0d178a39f3 service nova] Acquired lock "refresh_cache-f279b153-a1c9-46f5-a0c5-4574ab956ba8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:52:12 user nova-compute[71364]: DEBUG nova.network.neutron [req-56835ba9-c4fc-4697-8d48-22eafda56e76 req-e4a0bab6-9773-46c7-b0f6-7c0d178a39f3 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Refreshing network info cache for port 327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:52:13 user nova-compute[71364]: DEBUG nova.network.neutron [req-56835ba9-c4fc-4697-8d48-22eafda56e76 req-e4a0bab6-9773-46c7-b0f6-7c0d178a39f3 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Updated VIF entry in instance network info cache for port 327f645b-e31b-4f09-88d2-a53f8a29905c. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:52:13 user nova-compute[71364]: DEBUG nova.network.neutron [req-56835ba9-c4fc-4697-8d48-22eafda56e76 req-e4a0bab6-9773-46c7-b0f6-7c0d178a39f3 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Updating instance_info_cache with network_info: [{"id": "327f645b-e31b-4f09-88d2-a53f8a29905c", "address": "fa:16:3e:04:64:b5", "network": {"id": "35726c30-f646-4544-9320-15be81152224", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1748990227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fd1e1c38499497f8e19c68ac192664c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap327f645b-e3", "ovs_interfaceid": "327f645b-e31b-4f09-88d2-a53f8a29905c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:52:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-56835ba9-c4fc-4697-8d48-22eafda56e76 req-e4a0bab6-9773-46c7-b0f6-7c0d178a39f3 service nova] Releasing lock "refresh_cache-f279b153-a1c9-46f5-a0c5-4574ab956ba8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:52:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG nova.objects.instance [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lazy-loading 'flavor' on Instance uuid f279b153-a1c9-46f5-a0c5-4574ab956ba8 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:14 user nova-compute[71364]: INFO nova.compute.manager [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Attaching volume e0dc4100-c38a-4368-9578-27a42902e520 to /dev/sdc
Apr 11 21:52:14 user nova-compute[71364]: DEBUG os_brick.utils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6106561f-2385-49df-9e0a-bb287612a1da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d13344-ac38-47ae-8b85-dfd4ffc36040]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[36736255-b01f-4705-8381-38b255721026]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0a33ab-4fa6-4331-86ef-f44fab56b01a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:52:14 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:52:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecc5f3a-4160-409d-853b-0f567d152153]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG os_brick.utils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:14 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Updating existing volume attachment record: 7c67eebb-cf50-4418-aeac-a01bddb8331a {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:52:15 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681249920.8923054, 13124f93-665b-4107-bd71-16674bdb9a64 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:52:15 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] VM Stopped (Lifecycle Event)
Apr 11 21:52:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-96374510-a796-4960-8ba8-8439d703dfcb None None] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:52:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:16 user nova-compute[71364]: DEBUG nova.compute.manager [req-246147d5-1239-4c5c-9c54-832ae9131ff6 req-4c71a1fc-6f2c-4acc-98dc-ebde5d7e6ce0 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received event network-changed-875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:16 user nova-compute[71364]: DEBUG nova.compute.manager [req-246147d5-1239-4c5c-9c54-832ae9131ff6 req-4c71a1fc-6f2c-4acc-98dc-ebde5d7e6ce0 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Refreshing instance network info cache due to event network-changed-875f44f1-120e-48bc-9742-662c6bb93332. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:52:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-246147d5-1239-4c5c-9c54-832ae9131ff6 req-4c71a1fc-6f2c-4acc-98dc-ebde5d7e6ce0 service nova] Acquiring lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:52:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-246147d5-1239-4c5c-9c54-832ae9131ff6 req-4c71a1fc-6f2c-4acc-98dc-ebde5d7e6ce0 service nova] Acquired lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:52:16 user nova-compute[71364]: DEBUG nova.network.neutron [req-246147d5-1239-4c5c-9c54-832ae9131ff6 req-4c71a1fc-6f2c-4acc-98dc-ebde5d7e6ce0 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Refreshing network info cache for port 875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:52:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "interface-335d5305-28e6-4766-b0b2-b56848ff8652-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "interface-335d5305-28e6-4766-b0b2-b56848ff8652-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:16 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lazy-loading 'flavor' on Instance uuid 335d5305-28e6-4766-b0b2-b56848ff8652 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:16 user nova-compute[71364]: DEBUG nova.network.neutron [req-246147d5-1239-4c5c-9c54-832ae9131ff6 req-4c71a1fc-6f2c-4acc-98dc-ebde5d7e6ce0 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Updated VIF entry in instance network info cache for port 875f44f1-120e-48bc-9742-662c6bb93332. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:52:16 user nova-compute[71364]: DEBUG nova.network.neutron [req-246147d5-1239-4c5c-9c54-832ae9131ff6 req-4c71a1fc-6f2c-4acc-98dc-ebde5d7e6ce0 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Updating instance_info_cache with network_info: [{"id": "875f44f1-120e-48bc-9742-662c6bb93332", "address": "fa:16:3e:27:80:f5", "network": {"id": "35eb0a23-469f-4f8a-8c16-1cea8207fd79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1614521033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875f44f1-12", "ovs_interfaceid": "875f44f1-120e-48bc-9742-662c6bb93332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:52:16 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lazy-loading 'pci_requests' on Instance uuid 335d5305-28e6-4766-b0b2-b56848ff8652 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:16 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:52:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-246147d5-1239-4c5c-9c54-832ae9131ff6 req-4c71a1fc-6f2c-4acc-98dc-ebde5d7e6ce0 service nova] Releasing lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:52:16 user nova-compute[71364]: DEBUG nova.policy [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08dd18a54a074e658d08ca381e0c87ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ba7063a25043fdb16f3e1f0c0c51d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:52:17 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Successfully created port: 8067fe72-d5ad-4344-9a80-490071a443e3 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:52:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-612f0e37-f12d-4649-81d5-c4edd5a5f99d req-f1b6f836-887b-47db-9880-a9e8238440b3 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Received event network-changed-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-612f0e37-f12d-4649-81d5-c4edd5a5f99d req-f1b6f836-887b-47db-9880-a9e8238440b3 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Refreshing instance network info cache due to event network-changed-2bf7ba51-4360-45c5-bada-6d7113ca3aa5. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:52:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-612f0e37-f12d-4649-81d5-c4edd5a5f99d req-f1b6f836-887b-47db-9880-a9e8238440b3 service nova] Acquiring lock "refresh_cache-71a04a77-49b8-4d4a-bc66-e233aa7eab08" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:52:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-612f0e37-f12d-4649-81d5-c4edd5a5f99d req-f1b6f836-887b-47db-9880-a9e8238440b3 service nova] Acquired lock "refresh_cache-71a04a77-49b8-4d4a-bc66-e233aa7eab08" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:52:17 user nova-compute[71364]: DEBUG nova.network.neutron [req-612f0e37-f12d-4649-81d5-c4edd5a5f99d req-f1b6f836-887b-47db-9880-a9e8238440b3 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Refreshing network info cache for port 2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:52:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "5a3b5455-983c-4c30-b229-8922443af209" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "5a3b5455-983c-4c30-b229-8922443af209" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:17 user nova-compute[71364]: DEBUG nova.objects.instance [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lazy-loading 'flavor' on Instance uuid 5a3b5455-983c-4c30-b229-8922443af209 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "5a3b5455-983c-4c30-b229-8922443af209" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "5a3b5455-983c-4c30-b229-8922443af209" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "5a3b5455-983c-4c30-b229-8922443af209" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:18 user nova-compute[71364]: INFO nova.compute.manager [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Attaching volume d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 to /dev/vdb
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.utils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Successfully updated port: 8067fe72-d5ad-4344-9a80-490071a443e3 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c382114c-3580-43dd-9de5-52599882e603]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquired lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6fd45b-8515-47de-a180-bf8ea2439a9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-f7728587-f55d-4041-a36f-3e20c64b13dd req-c8f3bb50-436a-41f2-acc7-438b58a931c4 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received event network-changed-8067fe72-d5ad-4344-9a80-490071a443e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-f7728587-f55d-4041-a36f-3e20c64b13dd req-c8f3bb50-436a-41f2-acc7-438b58a931c4 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Refreshing instance network info cache due to event network-changed-8067fe72-d5ad-4344-9a80-490071a443e3. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f7728587-f55d-4041-a36f-3e20c64b13dd req-c8f3bb50-436a-41f2-acc7-438b58a931c4 service nova] Acquiring lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b160cf22-9fa3-4890-844b-7ba103812d13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6863afee-6bcd-4d45-ace6-2b196c71b3a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:52:18 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0a1a42-5426-41d8-a238-6ec40bc68bb6]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.utils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Updating existing volume attachment record: 1c5340ed-a57d-4afa-9b95-21654ef4105b {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG nova.network.neutron [req-612f0e37-f12d-4649-81d5-c4edd5a5f99d req-f1b6f836-887b-47db-9880-a9e8238440b3 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Updated VIF entry in instance network info cache for port 2bf7ba51-4360-45c5-bada-6d7113ca3aa5. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG nova.network.neutron [req-612f0e37-f12d-4649-81d5-c4edd5a5f99d req-f1b6f836-887b-47db-9880-a9e8238440b3 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Updating instance_info_cache with network_info: [{"id": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "address": "fa:16:3e:c2:69:1f", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7ba51-43", "ovs_interfaceid": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-612f0e37-f12d-4649-81d5-c4edd5a5f99d req-f1b6f836-887b-47db-9880-a9e8238440b3 service nova] Releasing lock "refresh_cache-71a04a77-49b8-4d4a-bc66-e233aa7eab08" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fmYrwbAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:18 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:18 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:18 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9c2ebd-3773-4e76-a25c-9ff9af2edd2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:52:18 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb14babc-4291-4c7a-8b2b-8a1338118f1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520] added
Apr 11 21:52:18 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Updating instance_info_cache with network_info: [{"id": "875f44f1-120e-48bc-9742-662c6bb93332", "address": "fa:16:3e:27:80:f5", "network": {"id": "35eb0a23-469f-4f8a-8c16-1cea8207fd79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1614521033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875f44f1-12", "ovs_interfaceid": "875f44f1-120e-48bc-9742-662c6bb93332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8067fe72-d5ad-4344-9a80-490071a443e3", "address": "fa:16:3e:3b:65:b4", "network": {"id": "5bf0dd8c-7a68-47b4-ab73-667890d8353f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1014832824", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8067fe72-d5", "ovs_interfaceid": "8067fe72-d5ad-4344-9a80-490071a443e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b4bf5a-cf5e-454b-962b-45420d7f5e6f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Releasing lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f7728587-f55d-4041-a36f-3e20c64b13dd req-c8f3bb50-436a-41f2-acc7-438b58a931c4 service nova] Acquired lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG nova.network.neutron [req-f7728587-f55d-4041-a36f-3e20c64b13dd req-c8f3bb50-436a-41f2-acc7-438b58a931c4 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Refreshing network info cache for port 8067fe72-d5ad-4344-9a80-490071a443e3 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-221002458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-221002458',id=6,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9SP67fRzYDr8pH3V24PAo6C5dZmRotW5QhNbjR+STaXowwhPQJNMYnIBrtgPE8JNDkIhvyxuwrwGRJsSpYFrzFZJJ9OejIdMCTzPDQ0PbvVC018NQN2jkSZDBN+Zyluw==',key_name='tempest-keypair-156975459',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2ba7063a25043fdb16f3e1f0c0c51d3',ramdisk_id='',reservation_id='r-0l47ba19',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2065530295',owner_user_name='tempest-TaggedAttachmentsTest-2065530295-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08dd18a54a074e658d08ca381e0c87ff',uuid=335d5305-28e6-4766-b0b2-b56848ff8652,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8067fe72-d5ad-4344-9a80-490071a443e3", "address": "fa:16:3e:3b:65:b4", "network": {"id": "5bf0dd8c-7a68-47b4-ab73-667890d8353f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1014832824", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8067fe72-d5", "ovs_interfaceid": "8067fe72-d5ad-4344-9a80-490071a443e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Converting VIF {"id": "8067fe72-d5ad-4344-9a80-490071a443e3", "address": "fa:16:3e:3b:65:b4", "network": {"id": "5bf0dd8c-7a68-47b4-ab73-667890d8353f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1014832824", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8067fe72-d5", "ovs_interfaceid": "8067fe72-d5ad-4344-9a80-490071a443e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:65:b4,bridge_name='br-int',has_traffic_filtering=True,id=8067fe72-d5ad-4344-9a80-490071a443e3,network=Network(5bf0dd8c-7a68-47b4-ab73-667890d8353f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8067fe72-d5') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_vif [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:65:b4,bridge_name='br-int',has_traffic_filtering=True,id=8067fe72-d5ad-4344-9a80-490071a443e3,network=Network(5bf0dd8c-7a68-47b4-ab73-667890d8353f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8067fe72-d5') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[386441af-bb4e-4d78-9dbc-6a2d2fca3f22]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fmYrwbAz {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8067fe72-d5, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8067fe72-d5, col_values=(('external_ids', {'iface-id': '8067fe72-d5ad-4344-9a80-490071a443e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:65:b4', 'vm-uuid': '335d5305-28e6-4766-b0b2-b56848ff8652'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:52:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:19 user nova-compute[71364]: INFO os_vif [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:65:b4,bridge_name='br-int',has_traffic_filtering=True,id=8067fe72-d5ad-4344-9a80-490071a443e3,network=Network(5bf0dd8c-7a68-47b4-ab73-667890d8353f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8067fe72-d5')
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-221002458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-221002458',id=6,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9SP67fRzYDr8pH3V24PAo6C5dZmRotW5QhNbjR+STaXowwhPQJNMYnIBrtgPE8JNDkIhvyxuwrwGRJsSpYFrzFZJJ9OejIdMCTzPDQ0PbvVC018NQN2jkSZDBN+Zyluw==',key_name='tempest-keypair-156975459',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2ba7063a25043fdb16f3e1f0c0c51d3',ramdisk_id='',reservation_id='r-0l47ba19',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2065530295',owner_user_name='tempest-TaggedAttachmentsTest-2065530295-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08dd18a54a074e658d08ca381e0c87ff',uuid=335d5305-28e6-4766-b0b2-b56848ff8652,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8067fe72-d5ad-4344-9a80-490071a443e3", "address": "fa:16:3e:3b:65:b4", "network": {"id": "5bf0dd8c-7a68-47b4-ab73-667890d8353f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1014832824", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8067fe72-d5", "ovs_interfaceid": "8067fe72-d5ad-4344-9a80-490071a443e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Converting VIF {"id": "8067fe72-d5ad-4344-9a80-490071a443e3", "address": "fa:16:3e:3b:65:b4", "network": {"id": "5bf0dd8c-7a68-47b4-ab73-667890d8353f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1014832824", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8067fe72-d5", "ovs_interfaceid": "8067fe72-d5ad-4344-9a80-490071a443e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:65:b4,bridge_name='br-int',has_traffic_filtering=True,id=8067fe72-d5ad-4344-9a80-490071a443e3,network=Network(5bf0dd8c-7a68-47b4-ab73-667890d8353f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8067fe72-d5') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fmYrwbAz" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce1aee8-b0ea-46ad-a6d6-46078289a97e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] attach device xml: <interface type="ethernet">
Apr 11 21:52:19 user nova-compute[71364]:   <mac address="fa:16:3e:3b:65:b4"/>
Apr 11 21:52:19 user nova-compute[71364]:   <model type="virtio"/>
Apr 11 21:52:19 user nova-compute[71364]:   <mtu size="1442"/>
Apr 11 21:52:19 user nova-compute[71364]:   <target dev="tap8067fe72-d5"/>
Apr 11 21:52:19 user nova-compute[71364]: </interface>
Apr 11 21:52:19 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fmYrwbAz'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c71cbb-c22f-4c29-ab06-20abe83d1203]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef3da86-a2c6-44df-8099-357a65c8d15e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:19 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:19 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:19 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:19 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c841ab6c-05f3-4d65-9dd2-bc4dbbbf4afd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520, portal: 172.16.0.220,3260]
Apr 11 21:52:19 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f73674-4298-4444-877b-31f14014e373]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11c74ca-d3f8-462b-b73a-59c101edc5b2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:19 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:19 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:19 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:19 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:19 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:19 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.objects.instance [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lazy-loading 'flavor' on Instance uuid 71a04a77-49b8-4d4a-bc66-e233aa7eab08 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.085s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da8a776-76c2-49aa-a374-796392a44f37]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: None {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] No BDM found with device name hda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] No VIF found with MAC fa:16:3e:27:80:f5, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:52:19 user nova-compute[71364]:   <nova:package version="0.0.0"/>
Apr 11 21:52:19 user nova-compute[71364]:   <nova:name>tempest-device-tagging-server-221002458</nova:name>
Apr 11 21:52:19 user nova-compute[71364]:   <nova:creationTime>2023-04-11 21:52:19</nova:creationTime>
Apr 11 21:52:19 user nova-compute[71364]:   <nova:flavor name="m1.nano">
Apr 11 21:52:19 user nova-compute[71364]:     <nova:memory>128</nova:memory>
Apr 11 21:52:19 user nova-compute[71364]:     <nova:disk>1</nova:disk>
Apr 11 21:52:19 user nova-compute[71364]:     <nova:swap>0</nova:swap>
Apr 11 21:52:19 user nova-compute[71364]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:52:19 user nova-compute[71364]:     <nova:vcpus>1</nova:vcpus>
Apr 11 21:52:19 user nova-compute[71364]:   </nova:flavor>
Apr 11 21:52:19 user nova-compute[71364]:   <nova:owner>
Apr 11 21:52:19 user nova-compute[71364]:     <nova:user uuid="08dd18a54a074e658d08ca381e0c87ff">tempest-TaggedAttachmentsTest-2065530295-project-member</nova:user>
Apr 11 21:52:19 user nova-compute[71364]:     <nova:project uuid="c2ba7063a25043fdb16f3e1f0c0c51d3">tempest-TaggedAttachmentsTest-2065530295</nova:project>
Apr 11 21:52:19 user nova-compute[71364]:   </nova:owner>
Apr 11 21:52:19 user nova-compute[71364]:   <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:52:19 user nova-compute[71364]:   <nova:ports>
Apr 11 21:52:19 user nova-compute[71364]:     <nova:port uuid="875f44f1-120e-48bc-9742-662c6bb93332">
Apr 11 21:52:19 user nova-compute[71364]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 21:52:19 user nova-compute[71364]:     </nova:port>
Apr 11 21:52:19 user nova-compute[71364]:     <nova:port uuid="8067fe72-d5ad-4344-9a80-490071a443e3">
Apr 11 21:52:19 user nova-compute[71364]:       <nova:ip type="fixed" address="10.10.10.127" ipVersion="4"/>
Apr 11 21:52:19 user nova-compute[71364]:     </nova:port>
Apr 11 21:52:19 user nova-compute[71364]:   </nova:ports>
Apr 11 21:52:19 user nova-compute[71364]: </nova:instance>
Apr 11 21:52:19 user nova-compute[71364]:  {{(pid=71364) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "interface-335d5305-28e6-4766-b0b2-b56848ff8652-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.013s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.network.neutron [req-f7728587-f55d-4041-a36f-3e20c64b13dd req-c8f3bb50-436a-41f2-acc7-438b58a931c4 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Updated VIF entry in instance network info cache for port 8067fe72-d5ad-4344-9a80-490071a443e3. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.network.neutron [req-f7728587-f55d-4041-a36f-3e20c64b13dd req-c8f3bb50-436a-41f2-acc7-438b58a931c4 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Updating instance_info_cache with network_info: [{"id": "875f44f1-120e-48bc-9742-662c6bb93332", "address": "fa:16:3e:27:80:f5", "network": {"id": "35eb0a23-469f-4f8a-8c16-1cea8207fd79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1614521033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875f44f1-12", "ovs_interfaceid": "875f44f1-120e-48bc-9742-662c6bb93332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8067fe72-d5ad-4344-9a80-490071a443e3", "address": "fa:16:3e:3b:65:b4", "network": {"id": "5bf0dd8c-7a68-47b4-ab73-667890d8353f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1014832824", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8067fe72-d5", "ovs_interfaceid": "8067fe72-d5ad-4344-9a80-490071a443e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f7728587-f55d-4041-a36f-3e20c64b13dd req-c8f3bb50-436a-41f2-acc7-438b58a931c4 service nova] Releasing lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:19 user nova-compute[71364]: INFO nova.compute.manager [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Attaching volume c8ca6da6-6a81-4942-a70d-2b26f9f17379 to /dev/vdb
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.utils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2343a05-3b9c-4193-a4a9-8af942d51e83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb569e01-b389-4570-a3ee-95fd0a65391c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16616eb-5b20-4e50-aa4b-4647b0550646]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed99025b-4f82-4462-8574-63f5a88edefd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.compute.manager [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Received event network-changed-70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.compute.manager [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Refreshing instance network info cache due to event network-changed-70618f68-d426-45e0-aa51-0bffb5b512f5. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] Acquiring lock "refresh_cache-5a3b5455-983c-4c30-b229-8922443af209" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] Acquired lock "refresh_cache-5a3b5455-983c-4c30-b229-8922443af209" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.network.neutron [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Refreshing network info cache for port 70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:52:19 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[453ace46-db74-4d89-ab95-e5e742f77429]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG os_brick.utils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Updating existing volume attachment record: 18ecc719-de93-4e23-bcef-53a1d31a81ae {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "335d5305-28e6-4766-b0b2-b56848ff8652" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "335d5305-28e6-4766-b0b2-b56848ff8652" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG nova.objects.instance [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lazy-loading 'flavor' on Instance uuid 335d5305-28e6-4766-b0b2-b56848ff8652 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "335d5305-28e6-4766-b0b2-b56848ff8652" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "335d5305-28e6-4766-b0b2-b56848ff8652" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "335d5305-28e6-4766-b0b2-b56848ff8652" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:20 user nova-compute[71364]: INFO nova.compute.manager [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Attaching volume 35c9789a-16d8-49b7-9a92-cc945ebd44e1 to /dev/vdb
Apr 11 21:52:20 user nova-compute[71364]: DEBUG os_brick.utils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[faeeaa0a-06b2-4c6d-b078-24ae2925ff40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cddc25-d8a3-4530-a0a8-8b7f9720e5f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6021e1-7297-4bb7-94d9-e46e3061201b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8665243-7bbd-4b05-a5be-173cf8ca74a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:52:20 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab6da28-aab0-4e11-b93c-66f3d0c1c717]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG os_brick.utils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Updating existing volume attachment record: 7007c9e1-7bf7-4838-9a97-9fdc3160f169 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fmYrwbAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] <== connect_volume: return (1490ms) {'type': 'block', 'scsi_wwn': '26236316635663136', 'path': '/dev/sde'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236316635663136', 'path': '/dev/sde'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG nova.network.neutron [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Updated VIF entry in instance network info cache for port 70618f68-d426-45e0-aa51-0bffb5b512f5. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG nova.network.neutron [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Updating instance_info_cache with network_info: [{"id": "70618f68-d426-45e0-aa51-0bffb5b512f5", "address": "fa:16:3e:8e:c6:90", "network": {"id": "09ba5156-0533-4c89-98d7-01da7903e7fa", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1375351384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1a9b6214384320b7d75e890e569b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70618f68-d4", "ovs_interfaceid": "70618f68-d426-45e0-aa51-0bffb5b512f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG nova.objects.instance [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lazy-loading 'flavor' on Instance uuid f279b153-a1c9-46f5-a0c5-4574ab956ba8 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] Releasing lock "refresh_cache-5a3b5455-983c-4c30-b229-8922443af209" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received event network-vif-plugged-8067fe72-d5ad-4344-9a80-490071a443e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] Acquiring lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] No waiting events found dispatching network-vif-plugged-8067fe72-d5ad-4344-9a80-490071a443e3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:20 user nova-compute[71364]: WARNING nova.compute.manager [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received unexpected event network-vif-plugged-8067fe72-d5ad-4344-9a80-490071a443e3 for instance with vm_state active and task_state None.
Apr 11 21:52:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:52:20 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:52:20 user nova-compute[71364]:   <source dev="/dev/sde"/>
Apr 11 21:52:20 user nova-compute[71364]:   <target dev="sdc" bus="scsi"/>
Apr 11 21:52:20 user nova-compute[71364]:   <serial>e0dc4100-c38a-4368-9578-27a42902e520</serial>
Apr 11 21:52:20 user nova-compute[71364]:   <address type="drive" controller="0" unit="2"/>
Apr 11 21:52:20 user nova-compute[71364]: </disk>
Apr 11 21:52:20 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] No BDM found with device name sda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:52:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] No VIF found with MAC fa:16:3e:04:64:b5, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:52:21 user nova-compute[71364]: DEBUG nova.compute.manager [req-5aa34bd5-f967-4e6c-98ec-564f3cf5ec04 req-358042de-f927-4ad6-9156-255e2d5ad221 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received event network-vif-plugged-8067fe72-d5ad-4344-9a80-490071a443e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5aa34bd5-f967-4e6c-98ec-564f3cf5ec04 req-358042de-f927-4ad6-9156-255e2d5ad221 service nova] Acquiring lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5aa34bd5-f967-4e6c-98ec-564f3cf5ec04 req-358042de-f927-4ad6-9156-255e2d5ad221 service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5aa34bd5-f967-4e6c-98ec-564f3cf5ec04 req-358042de-f927-4ad6-9156-255e2d5ad221 service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:21 user nova-compute[71364]: DEBUG nova.compute.manager [req-5aa34bd5-f967-4e6c-98ec-564f3cf5ec04 req-358042de-f927-4ad6-9156-255e2d5ad221 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] No waiting events found dispatching network-vif-plugged-8067fe72-d5ad-4344-9a80-490071a443e3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:21 user nova-compute[71364]: WARNING nova.compute.manager [req-5aa34bd5-f967-4e6c-98ec-564f3cf5ec04 req-358042de-f927-4ad6-9156-255e2d5ad221 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received unexpected event network-vif-plugged-8067fe72-d5ad-4344-9a80-490071a443e3 for instance with vm_state active and task_state None.
Apr 11 21:52:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XltckDeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:23 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:23 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:23 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff02544-2e3e-4ac6-9360-f3e2a2494e05]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:52:23 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ed4de3-27b2-41d8-87a3-ce8a6f205a49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9] added
Apr 11 21:52:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[83258425-ed15-42df-955e-aab03351ffba]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa8fafd-c789-48fc-950a-52ca50c7061a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XltckDeG {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XltckDeG" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8679efb-e6ec-403b-8f86-f949f9d1ef79]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XltckDeG'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39f02d7-3c1a-4620-b3a4-055698102f91]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[741f74c6-7570-4911-9702-6f880fa57120]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:23 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:23 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:23 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:23 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:23 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:23 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.096s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[46738fe8-de86-4f06-9e90-5bece52fd91e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260]
Apr 11 21:52:23 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae248e5-9ff2-40cf-ae22-63590ad3398b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6711a9-8669-486a-aecf-a74dd7c95bd3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:23 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:23 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:23 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:23 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:23 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:23 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:23 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:23 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5472f881-1bda-400f-8875-f74a4a377cf2]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XltckDeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfwcvFYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:24 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23833616638633364', 'path': '/dev/sdf'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833616638633364', 'path': '/dev/sdf'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.290s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:24 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:24 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG nova.objects.instance [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lazy-loading 'flavor' on Instance uuid 5a3b5455-983c-4c30-b229-8922443af209 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4081bf83-cc33-4502-b514-43b9e303701c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:52:24 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[426547c9-f1d6-4b9d-a878-30e3f6431083]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379] added
Apr 11 21:52:24 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[935ff1f5-9670-465c-b8ef-e406bfc67f02]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:52:24 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:52:24 user nova-compute[71364]:   <source dev="/dev/sdf"/>
Apr 11 21:52:24 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:52:24 user nova-compute[71364]:   <serial>d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9</serial>
Apr 11 21:52:24 user nova-compute[71364]: </disk>
Apr 11 21:52:24 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[97af849a-1584-45cb-928d-42abc3904037]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kfwcvFYK {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kfwcvFYK" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d305f2-5d07-4036-a49b-67d825d6a336]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kfwcvFYK'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a368659f-a621-4ea0-950d-ed938b04e106]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bwGPsCtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:24 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e60881-006f-4921-9465-d24c0bb29d5d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54b0800-b759-4d83-828d-93cde52a3db7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379, portal: 172.16.0.220,3260]
Apr 11 21:52:24 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:24 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b34e99-7bd6-4089-ad59-c99f868831fc]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16d9453-fc0c-4c0f-b0be-ef3085d1e09a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)
Apr 11 21:52:24 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a001246-ea3c-4736-8c36-4bb3f62735b1]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:52:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfwcvFYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:25 user nova-compute[71364]: INFO nova.compute.manager [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Detaching volume e0dc4100-c38a-4368-9578-27a42902e520
Apr 11 21:52:25 user nova-compute[71364]: INFO nova.virt.block_device [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Attempting to driver detach volume e0dc4100-c38a-4368-9578-27a42902e520 from mountpoint /dev/sdc
Apr 11 21:52:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] No VIF found with MAC fa:16:3e:8e:c6:90, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Attempting to detach device sdc from instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:52:25 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:52:25 user nova-compute[71364]:   <source dev="/dev/sde"/>
Apr 11 21:52:25 user nova-compute[71364]:   <target dev="sdc" bus="scsi"/>
Apr 11 21:52:25 user nova-compute[71364]:   <serial>e0dc4100-c38a-4368-9578-27a42902e520</serial>
Apr 11 21:52:25 user nova-compute[71364]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 11 21:52:25 user nova-compute[71364]: </disk>
Apr 11 21:52:25 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:52:25 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Successfully detached device sdc from instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 from the persistent domain config.
Apr 11 21:52:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:52:25 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:52:25 user nova-compute[71364]:   <source dev="/dev/sde"/>
Apr 11 21:52:25 user nova-compute[71364]:   <target dev="sdc" bus="scsi"/>
Apr 11 21:52:25 user nova-compute[71364]:   <serial>e0dc4100-c38a-4368-9578-27a42902e520</serial>
Apr 11 21:52:25 user nova-compute[71364]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 11 21:52:25 user nova-compute[71364]: </disk>
Apr 11 21:52:25 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "5a3b5455-983c-4c30-b229-8922443af209" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.147s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681249945.5239656, f279b153-a1c9-46f5-a0c5-4574ab956ba8 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:52:25 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Successfully detached device sdc from instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 from the live domain config.
Apr 11 21:52:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fmYrwbAz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:25 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] <== connect_volume: return (1669ms) {'type': 'block', 'scsi_wwn': '23932393763336236', 'path': '/dev/sdg'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932393763336236', 'path': '/dev/sdg'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.184s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:25 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:25 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:52:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:25 user nova-compute[71364]: DEBUG nova.objects.instance [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lazy-loading 'flavor' on Instance uuid 71a04a77-49b8-4d4a-bc66-e233aa7eab08 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68aa186-b8c3-4679-92ea-e149ebb21d7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:52:26 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:52:26 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:52:26 user nova-compute[71364]:   <source dev="/dev/sdg"/>
Apr 11 21:52:26 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:52:26 user nova-compute[71364]:   <serial>c8ca6da6-6a81-4942-a70d-2b26f9f17379</serial>
Apr 11 21:52:26 user nova-compute[71364]: </disk>
Apr 11 21:52:26 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f62dc3-6e24-4dac-8e1b-07a2b02b542c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1] added
Apr 11 21:52:26 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[012d43f2-97b8-4fc3-a026-e6d347203dfc]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1f74f7-afe2-4f53-a326-686df934ce6f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bwGPsCtU {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bwGPsCtU" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d62069-cb81-4b3b-9a00-1f20c4e27576]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bwGPsCtU'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04d22e0-3b8a-4003-b2b9-b9e043f8683b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1340d9e7-213c-441d-bb6c-6a8e1b6b2dab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Acquiring lock "5a3b5455-983c-4c30-b229-8922443af209" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "5a3b5455-983c-4c30-b229-8922443af209" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.utils [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fafcff-d8ac-4286-bf72-cb1dc188884b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dda28f8-2601-4a4d-8492-80db96aea909]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cd92ac-7b17-4394-b42d-66575223f89e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1, portal: 172.16.0.220,3260]
Apr 11 21:52:26 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:26 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[696ec98b-3d6d-4595-9c03-e7c9dffc36fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[304bd6ee-3789-4047-a6bc-92895b2fab5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc068f74-69bb-4a81-9a06-b75d561a4376]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:52:26 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dd06b5-1236-4855-b473-4a02cfed944b]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.utils [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a74d0f-64fc-47da-98bb-6cc5a35a82b4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 (non-flash)
Apr 11 21:52:26 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc49a7b1-1dea-4fd4-8cb5-5e571310bae3]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bwGPsCtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:52:26 user nova-compute[71364]: INFO nova.compute.manager [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Swapping volume d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 for b9470c4c-3635-41c7-96df-24125ae941a9
Apr 11 21:52:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] No VIF found with MAC fa:16:3e:c2:69:1f, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:52:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.105s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] <== connect_volume: return (2613ms) {'type': 'block', 'scsi_wwn': '23866333763616131', 'path': '/dev/sdh'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866333763616131', 'path': '/dev/sdh'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.871s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG nova.objects.instance [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lazy-loading 'flavor' on Instance uuid 335d5305-28e6-4766-b0b2-b56848ff8652 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc992b40-e2c9-4724-aece-e6c6d5414604]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:52:27 user nova-compute[71364]: No targets found.
Apr 11 21:52:27 user nova-compute[71364]: iSNS:
Apr 11 21:52:27 user nova-compute[71364]: No targets found.
Apr 11 21:52:27 user nova-compute[71364]: STATIC:
Apr 11 21:52:27 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540
Apr 11 21:52:27 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:27 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:27 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379
Apr 11 21:52:27 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:27 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:27 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1
Apr 11 21:52:27 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:27 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:27 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e
Apr 11 21:52:27 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:27 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:27 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520
Apr 11 21:52:27 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:27 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:27 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973
Apr 11 21:52:27 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:27 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:27 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9
Apr 11 21:52:27 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:27 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:27 user nova-compute[71364]: FIRMWARE:
Apr 11 21:52:27 user nova-compute[71364]: No targets found.
Apr 11 21:52:27 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:52:27 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:52:27 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:52:27 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:52:27 user nova-compute[71364]:   <source dev="/dev/sdh"/>
Apr 11 21:52:27 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:52:27 user nova-compute[71364]:   <serial>35c9789a-16d8-49b7-9a92-cc945ebd44e1</serial>
Apr 11 21:52:27 user nova-compute[71364]: </disk>
Apr 11 21:52:27 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ba2e31-da73-4147-8f0e-49a79aae6a6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf11dfdf-232b-48e7-a87f-e22b97428172]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:27 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:27 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:27 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:27 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:27 user nova-compute[71364]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)
Apr 11 21:52:27 user nova-compute[71364]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 (non-flash)
Apr 11 21:52:27 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:27 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:27 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:27 user nova-compute[71364]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 (non-flash)
Apr 11 21:52:27 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:27 user nova-compute[71364]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)
Apr 11 21:52:27 user nova-compute[71364]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 (non-flash)
Apr 11 21:52:27 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff757010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520'): ({'sde'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Removing single pathed devices sde {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df4b81c-c12d-4894-be81-11ec29d303b0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3381054-100a-473b-8050-05d512bfccd0]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Flushing IO for device /dev/sde {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5953ed0d-fb20-4f2f-b9c1-f9c47454735d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70f0697-69cf-4405-886f-7acf4c0125c5]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ffa1ad-da1c-4065-8e45-79c5762c5bad]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a956a7bd-2d27-4981-9a8d-694787b0c0d6]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520, portal: 172.16.0.220,3260]
Apr 11 21:52:27 user nova-compute[71364]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:27 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0dc4100-c38a-4368-9578-27a42902e520 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f812313e-af55-491a-9f8f-d90209e90a67]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] <== disconnect_volume: return (2198ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] No BDM found with device name hda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:52:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] No VIF found with MAC fa:16:3e:27:80:f5, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "335d5305-28e6-4766-b0b2-b56848ff8652" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.951s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:28 user nova-compute[71364]: INFO nova.compute.manager [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Detaching volume c8ca6da6-6a81-4942-a70d-2b26f9f17379
Apr 11 21:52:28 user nova-compute[71364]: INFO nova.virt.block_device [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Attempting to driver detach volume c8ca6da6-6a81-4942-a70d-2b26f9f17379 from mountpoint /dev/vdb
Apr 11 21:52:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Attempting to detach device vdb from instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:52:28 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:52:28 user nova-compute[71364]:   <source dev="/dev/sdg"/>
Apr 11 21:52:28 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:52:28 user nova-compute[71364]:   <serial>c8ca6da6-6a81-4942-a70d-2b26f9f17379</serial>
Apr 11 21:52:28 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:52:28 user nova-compute[71364]: </disk>
Apr 11 21:52:28 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:52:28 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Successfully detached device vdb from instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 from the persistent domain config.
Apr 11 21:52:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:52:28 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:52:28 user nova-compute[71364]:   <source dev="/dev/sdg"/>
Apr 11 21:52:28 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:52:28 user nova-compute[71364]:   <serial>c8ca6da6-6a81-4942-a70d-2b26f9f17379</serial>
Apr 11 21:52:28 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:52:28 user nova-compute[71364]: </disk>
Apr 11 21:52:28 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG nova.objects.instance [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lazy-loading 'flavor' on Instance uuid f279b153-a1c9-46f5-a0c5-4574ab956ba8 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.644s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681249948.7372198, 71a04a77-49b8-4d4a-bc66-e233aa7eab08 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:52:28 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Successfully detached device vdb from instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 from the live domain config.
Apr 11 21:52:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kfwcvFYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:28 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a064a46-0462-4ff4-aea4-47d11635280b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:52:28 user nova-compute[71364]: No targets found.
Apr 11 21:52:28 user nova-compute[71364]: iSNS:
Apr 11 21:52:28 user nova-compute[71364]: No targets found.
Apr 11 21:52:28 user nova-compute[71364]: STATIC:
Apr 11 21:52:28 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540
Apr 11 21:52:28 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:28 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:28 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379
Apr 11 21:52:28 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:28 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:28 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1
Apr 11 21:52:28 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:28 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:28 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e
Apr 11 21:52:28 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:28 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:28 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973
Apr 11 21:52:28 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:28 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:28 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9
Apr 11 21:52:28 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:28 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:28 user nova-compute[71364]: FIRMWARE:
Apr 11 21:52:28 user nova-compute[71364]: No targets found.
Apr 11 21:52:28 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:52:28 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:52:28 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b10c626-10c2-4e04-9312-4e6a74fcf4b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[615cd7eb-fd0e-431b-a084-f362d443a426]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:28 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:28 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:28 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:28 user nova-compute[71364]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)
Apr 11 21:52:28 user nova-compute[71364]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 (non-flash)
Apr 11 21:52:28 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:28 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:28 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:28 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:28 user nova-compute[71364]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 (non-flash)
Apr 11 21:52:28 user nova-compute[71364]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 (non-flash)
Apr 11 21:52:28 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff7a0670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379'): ({'sdg'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Removing single pathed devices sdg {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb08dee-0681-46f9-a80b-d02275a4c800]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2b7c0a-eb05-40ad-9a15-e28eb94bdd5d]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Flushing IO for device /dev/sdg {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0db2bef-f742-4434-b9a5-cf7588dd3553]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6170f3-9924-4a54-940e-6fae0a1f927f]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] SCSI volumes sdg have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[49311fc2-6bf5-47c4-a25b-4933afc09e54]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f4e0a7-53be-4b40-a4da-5f1c4d93c514]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379, portal: 172.16.0.220,3260]
Apr 11 21:52:29 user nova-compute[71364]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:29 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8ca6da6-6a81-4942-a70d-2b26f9f17379 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07f8c12-3d83-4602-9fe3-601b02a216e1]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] <== disconnect_volume: return (312ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "335d5305-28e6-4766-b0b2-b56848ff8652" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "335d5305-28e6-4766-b0b2-b56848ff8652" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:29 user nova-compute[71364]: INFO nova.compute.manager [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Detaching volume 35c9789a-16d8-49b7-9a92-cc945ebd44e1
Apr 11 21:52:29 user nova-compute[71364]: DEBUG nova.objects.instance [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lazy-loading 'flavor' on Instance uuid 71a04a77-49b8-4d4a-bc66-e233aa7eab08 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.751s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:29 user nova-compute[71364]: INFO nova.virt.block_device [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Attempting to driver detach volume 35c9789a-16d8-49b7-9a92-cc945ebd44e1 from mountpoint /dev/vdb
Apr 11 21:52:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Attempting to detach device vdb from instance 335d5305-28e6-4766-b0b2-b56848ff8652 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:52:29 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:52:29 user nova-compute[71364]:   <source dev="/dev/sdh"/>
Apr 11 21:52:29 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:52:29 user nova-compute[71364]:   <serial>35c9789a-16d8-49b7-9a92-cc945ebd44e1</serial>
Apr 11 21:52:29 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 21:52:29 user nova-compute[71364]: </disk>
Apr 11 21:52:29 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:52:29 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Successfully detached device vdb from instance 335d5305-28e6-4766-b0b2-b56848ff8652 from the persistent domain config.
Apr 11 21:52:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 335d5305-28e6-4766-b0b2-b56848ff8652 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:52:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:52:29 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:52:29 user nova-compute[71364]:   <source dev="/dev/sdh"/>
Apr 11 21:52:29 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:52:29 user nova-compute[71364]:   <serial>35c9789a-16d8-49b7-9a92-cc945ebd44e1</serial>
Apr 11 21:52:29 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 21:52:29 user nova-compute[71364]: </disk>
Apr 11 21:52:29 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:30 user nova-compute[71364]: INFO nova.compute.manager [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Terminating instance
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-6df15269-d99d-439a-b10f-ecc77cccb232 req-401071de-2302-4e62-a466-aa3b8c101064 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Received event network-vif-unplugged-327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6df15269-d99d-439a-b10f-ecc77cccb232 req-401071de-2302-4e62-a466-aa3b8c101064 service nova] Acquiring lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6df15269-d99d-439a-b10f-ecc77cccb232 req-401071de-2302-4e62-a466-aa3b8c101064 service nova] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6df15269-d99d-439a-b10f-ecc77cccb232 req-401071de-2302-4e62-a466-aa3b8c101064 service nova] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-6df15269-d99d-439a-b10f-ecc77cccb232 req-401071de-2302-4e62-a466-aa3b8c101064 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] No waiting events found dispatching network-vif-unplugged-327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-6df15269-d99d-439a-b10f-ecc77cccb232 req-401071de-2302-4e62-a466-aa3b8c101064 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Received event network-vif-unplugged-327f645b-e31b-4f09-88d2-a53f8a29905c for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681249950.392033, 335d5305-28e6-4766-b0b2-b56848ff8652 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:52:30 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Successfully detached device vdb from instance 335d5305-28e6-4766-b0b2-b56848ff8652 from the live domain config.
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bwGPsCtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:30 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff12d12-65bf-440d-9a57-b12a76e42775]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:52:30 user nova-compute[71364]: No targets found.
Apr 11 21:52:30 user nova-compute[71364]: iSNS:
Apr 11 21:52:30 user nova-compute[71364]: No targets found.
Apr 11 21:52:30 user nova-compute[71364]: STATIC:
Apr 11 21:52:30 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540
Apr 11 21:52:30 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:30 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:30 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1
Apr 11 21:52:30 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:30 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:30 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e
Apr 11 21:52:30 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:30 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:30 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973
Apr 11 21:52:30 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:30 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:30 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9
Apr 11 21:52:30 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:30 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:30 user nova-compute[71364]: FIRMWARE:
Apr 11 21:52:30 user nova-compute[71364]: No targets found.
Apr 11 21:52:30 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:52:30 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:52:30 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c6bfad-7585-443b-908d-f414ff0d2b32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a267fa91-5684-44c9-8673-349807543be3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:30 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:30 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:30 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:30 user nova-compute[71364]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 (non-flash)
Apr 11 21:52:30 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:30 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:30 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:30 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:30 user nova-compute[71364]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 (non-flash)
Apr 11 21:52:30 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bd06cf490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1'): ({'sdh'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Removing single pathed devices sdh {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9754009-c57e-423a-8e82-d1c6b9e022f4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a949d31-4fb5-4e41-bc9d-7421e53003aa]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Flushing IO for device /dev/sdh {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e0d91b-cf91-409c-8582-1e06499190bd]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a5d843-bb05-49ab-a0b9-f87223676497]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] SCSI volumes sdh have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7331c35a-8164-4101-87fa-d92ae86d2fee]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee8b5d4-da79-4c26-8475-b73202766f12]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1, portal: 172.16.0.220,3260]
Apr 11 21:52:30 user nova-compute[71364]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:30 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35c9789a-16d8-49b7-9a92-cc945ebd44e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[984e5a58-53bf-4c4b-9368-6b25e76a0349]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] <== disconnect_volume: return (318ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:52:30 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Instance destroyed successfully.
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.objects.instance [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lazy-loading 'resources' on Instance uuid f279b153-a1c9-46f5-a0c5-4574ab956ba8 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1191919716',display_name='tempest-AttachSCSIVolumeTestJSON-server-1191919716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1191919716',id=5,image_ref='dafa0bc1-7a67-4b65-b80f-b61d19a80800',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZmW6Wfm7Cm10lK8Gby/74Xu70dkDdNfKx0+J90JYG69zVAuhB6Iyp4rnIXMAeonPMSjCxz7uGGCE2/d6KUlLjQ25M4KEhzrX4FF+u3bvtEurn5qw7S9e2w1QCl7YvJtQ==',key_name='tempest-keypair-1843059498',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:50:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fd1e1c38499497f8e19c68ac192664c',ramdisk_id='',reservation_id='r-de4swypx',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='dafa0bc1-7a67-4b65-b80f-b61d19a80800',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-213208191',owner_user_name='tempest-AttachSCSIVolumeTestJSON-213208191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:50:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9be8bb1eb0654966b5ef7303a65f79df',uuid=f279b153-a1c9-46f5-a0c5-4574ab956ba8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "327f645b-e31b-4f09-88d2-a53f8a29905c", "address": "fa:16:3e:04:64:b5", "network": {"id": "35726c30-f646-4544-9320-15be81152224", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1748990227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fd1e1c38499497f8e19c68ac192664c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap327f645b-e3", "ovs_interfaceid": "327f645b-e31b-4f09-88d2-a53f8a29905c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Converting VIF {"id": "327f645b-e31b-4f09-88d2-a53f8a29905c", "address": "fa:16:3e:04:64:b5", "network": {"id": "35726c30-f646-4544-9320-15be81152224", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1748990227-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fd1e1c38499497f8e19c68ac192664c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap327f645b-e3", "ovs_interfaceid": "327f645b-e31b-4f09-88d2-a53f8a29905c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:64:b5,bridge_name='br-int',has_traffic_filtering=True,id=327f645b-e31b-4f09-88d2-a53f8a29905c,network=Network(35726c30-f646-4544-9320-15be81152224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap327f645b-e3') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_vif [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:64:b5,bridge_name='br-int',has_traffic_filtering=True,id=327f645b-e31b-4f09-88d2-a53f8a29905c,network=Network(35726c30-f646-4544-9320-15be81152224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap327f645b-e3') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap327f645b-e3, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:30 user nova-compute[71364]: INFO os_vif [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:64:b5,bridge_name='br-int',has_traffic_filtering=True,id=327f645b-e31b-4f09-88d2-a53f8a29905c,network=Network(35726c30-f646-4544-9320-15be81152224),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap327f645b-e3')
Apr 11 21:52:30 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Deleting instance files /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8_del
Apr 11 21:52:30 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Deletion of /opt/stack/data/nova/instances/f279b153-a1c9-46f5-a0c5-4574ab956ba8_del complete
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyQXqOjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a3b5455-983c-4c30-b229-8922443af209', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9470c4c-3635-41c7-96df-24125ae941a9', 'serial': 'b9470c4c-3635-41c7-96df-24125ae941a9'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XltckDeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '5a3b5455-983c-4c30-b229-8922443af209', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 'serial'} {{(pid=71364) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyQXqOjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:30 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:30 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:30 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:30 user nova-compute[71364]: INFO nova.compute.manager [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ca4118-922f-4cb9-aa9c-213532cdbc1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:52:30 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d4b2e6-601f-4ed4-863d-62dc9c9fbf20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9] added
Apr 11 21:52:30 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead3899c-8868-4dd8-bdb3-b240dc7985b6]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6c9588-ebb6-4b64-9400-7e4ed17d9a35]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pyQXqOjS {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pyQXqOjS" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[58697816-3e37-4fa3-b115-3c0ccf918cd0]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pyQXqOjS'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0852616-f7ce-4214-add9-6bf3dfb45a57]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f52cb3f-86a1-447a-9453-1151aff65bed]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:31 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:31 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:31 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:31 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:31 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:31 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:31 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:31 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7a004d-ff2b-486c-9c66-8442c2a73e01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9, portal: 172.16.0.220,3260]
Apr 11 21:52:31 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:31 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[52763c0b-9640-425f-818a-e72ab0732431]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8259761b-ab4f-40d9-b05a-cbb5c9c1c27d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)
Apr 11 21:52:31 user nova-compute[71364]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:31 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:31 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:31 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:31 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)
Apr 11 21:52:31 user nova-compute[71364]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:31 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:31 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:31 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:31 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[392cfad5-0652-4a40-8da5-523a8b1d9c75]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: None {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lazy-loading 'flavor' on Instance uuid 335d5305-28e6-4766-b0b2-b56848ff8652 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "335d5305-28e6-4766-b0b2-b56848ff8652" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.792s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:52:32 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Took 1.09 seconds to deallocate network for instance.
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-3869f81b-e973-4003-bf01-071fdb4be442 req-f672a334-db7c-47b6-b592-0f5074080f99 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Received event network-vif-deleted-327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:32 user nova-compute[71364]: INFO nova.compute.manager [req-3869f81b-e973-4003-bf01-071fdb4be442 req-f672a334-db7c-47b6-b592-0f5074080f99 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Neutron deleted interface 327f645b-e31b-4f09-88d2-a53f8a29905c; detaching it from the instance and deleting it from the info cache
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.network.neutron [req-3869f81b-e973-4003-bf01-071fdb4be442 req-f672a334-db7c-47b6-b592-0f5074080f99 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-3869f81b-e973-4003-bf01-071fdb4be442 req-f672a334-db7c-47b6-b592-0f5074080f99 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Detach interface failed, port_id=327f645b-e31b-4f09-88d2-a53f8a29905c, reason: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "interface-335d5305-28e6-4766-b0b2-b56848ff8652-8067fe72-d5ad-4344-9a80-490071a443e3" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "interface-335d5305-28e6-4766-b0b2-b56848ff8652-8067fe72-d5ad-4344-9a80-490071a443e3" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.objects.instance [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lazy-loading 'flavor' on Instance uuid 335d5305-28e6-4766-b0b2-b56848ff8652 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-221002458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-221002458',id=6,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9SP67fRzYDr8pH3V24PAo6C5dZmRotW5QhNbjR+STaXowwhPQJNMYnIBrtgPE8JNDkIhvyxuwrwGRJsSpYFrzFZJJ9OejIdMCTzPDQ0PbvVC018NQN2jkSZDBN+Zyluw==',key_name='tempest-keypair-156975459',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2ba7063a25043fdb16f3e1f0c0c51d3',ramdisk_id='',reservation_id='r-0l47ba19',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2065530295',owner_user_name='tempest-TaggedAttachmentsTest-2065530295-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08dd18a54a074e658d08ca381e0c87ff',uuid=335d5305-28e6-4766-b0b2-b56848ff8652,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8067fe72-d5ad-4344-9a80-490071a443e3", "address": "fa:16:3e:3b:65:b4", "network": {"id": "5bf0dd8c-7a68-47b4-ab73-667890d8353f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1014832824", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8067fe72-d5", "ovs_interfaceid": "8067fe72-d5ad-4344-9a80-490071a443e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Converting VIF {"id": "8067fe72-d5ad-4344-9a80-490071a443e3", "address": "fa:16:3e:3b:65:b4", "network": {"id": "5bf0dd8c-7a68-47b4-ab73-667890d8353f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1014832824", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8067fe72-d5", "ovs_interfaceid": "8067fe72-d5ad-4344-9a80-490071a443e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:65:b4,bridge_name='br-int',has_traffic_filtering=True,id=8067fe72-d5ad-4344-9a80-490071a443e3,network=Network(5bf0dd8c-7a68-47b4-ab73-667890d8353f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8067fe72-d5') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:65:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8067fe72-d5"/></interface> {{(pid=71364) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:65:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8067fe72-d5"/></interface> {{(pid=71364) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Attempting to detach device tap8067fe72-d5 from instance 335d5305-28e6-4766-b0b2-b56848ff8652 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] detach device xml: <interface type="ethernet">
Apr 11 21:52:32 user nova-compute[71364]:   <mac address="fa:16:3e:3b:65:b4"/>
Apr 11 21:52:32 user nova-compute[71364]:   <model type="virtio"/>
Apr 11 21:52:32 user nova-compute[71364]:   <mtu size="1442"/>
Apr 11 21:52:32 user nova-compute[71364]:   <target dev="tap8067fe72-d5"/>
Apr 11 21:52:32 user nova-compute[71364]: </interface>
Apr 11 21:52:32 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:65:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8067fe72-d5"/></interface> {{(pid=71364) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3b:65:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8067fe72-d5"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 11 21:52:32 user nova-compute[71364]:   <name>instance-00000006</name>
Apr 11 21:52:32 user nova-compute[71364]:   <uuid>335d5305-28e6-4766-b0b2-b56848ff8652</uuid>
Apr 11 21:52:32 user nova-compute[71364]:   <metadata>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:52:32 user nova-compute[71364]:   <nova:package version="0.0.0"/>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:name>tempest-device-tagging-server-221002458</nova:name>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:creationTime>2023-04-11 21:52:19</nova:creationTime>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:flavor name="m1.nano">
Apr 11 21:52:32 user nova-compute[71364]:     <nova:memory>128</nova:memory>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:disk>1</nova:disk>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:swap>0</nova:swap>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:vcpus>1</nova:vcpus>
Apr 11 21:52:32 user nova-compute[71364]:   </nova:flavor>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:owner>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:user uuid="08dd18a54a074e658d08ca381e0c87ff">tempest-TaggedAttachmentsTest-2065530295-project-member</nova:user>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:project uuid="c2ba7063a25043fdb16f3e1f0c0c51d3">tempest-TaggedAttachmentsTest-2065530295</nova:project>
Apr 11 21:52:32 user nova-compute[71364]:   </nova:owner>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:ports>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:port uuid="875f44f1-120e-48bc-9742-662c6bb93332">
Apr 11 21:52:32 user nova-compute[71364]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 21:52:32 user nova-compute[71364]:     </nova:port>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:port uuid="8067fe72-d5ad-4344-9a80-490071a443e3">
Apr 11 21:52:32 user nova-compute[71364]:       <nova:ip type="fixed" address="10.10.10.127" ipVersion="4"/>
Apr 11 21:52:32 user nova-compute[71364]:     </nova:port>
Apr 11 21:52:32 user nova-compute[71364]:   </nova:ports>
Apr 11 21:52:32 user nova-compute[71364]: </nova:instance>
Apr 11 21:52:32 user nova-compute[71364]:   </metadata>
Apr 11 21:52:32 user nova-compute[71364]:   <memory unit='KiB'>131072</memory>
Apr 11 21:52:32 user nova-compute[71364]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 21:52:32 user nova-compute[71364]:   <vcpu placement='static'>1</vcpu>
Apr 11 21:52:32 user nova-compute[71364]:   <resource>
Apr 11 21:52:32 user nova-compute[71364]:     <partition>/machine</partition>
Apr 11 21:52:32 user nova-compute[71364]:   </resource>
Apr 11 21:52:32 user nova-compute[71364]:   <sysinfo type='smbios'>
Apr 11 21:52:32 user nova-compute[71364]:     <system>
Apr 11 21:52:32 user nova-compute[71364]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 21:52:32 user nova-compute[71364]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 21:52:32 user nova-compute[71364]:       <entry name='version'>0.0.0</entry>
Apr 11 21:52:32 user nova-compute[71364]:       <entry name='serial'>335d5305-28e6-4766-b0b2-b56848ff8652</entry>
Apr 11 21:52:32 user nova-compute[71364]:       <entry name='uuid'>335d5305-28e6-4766-b0b2-b56848ff8652</entry>
Apr 11 21:52:32 user nova-compute[71364]:       <entry name='family'>Virtual Machine</entry>
Apr 11 21:52:32 user nova-compute[71364]:     </system>
Apr 11 21:52:32 user nova-compute[71364]:   </sysinfo>
Apr 11 21:52:32 user nova-compute[71364]:   <os>
Apr 11 21:52:32 user nova-compute[71364]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 21:52:32 user nova-compute[71364]:     <boot dev='hd'/>
Apr 11 21:52:32 user nova-compute[71364]:     <smbios mode='sysinfo'/>
Apr 11 21:52:32 user nova-compute[71364]:   </os>
Apr 11 21:52:32 user nova-compute[71364]:   <features>
Apr 11 21:52:32 user nova-compute[71364]:     <acpi/>
Apr 11 21:52:32 user nova-compute[71364]:     <apic/>
Apr 11 21:52:32 user nova-compute[71364]:     <vmcoreinfo state='on'/>
Apr 11 21:52:32 user nova-compute[71364]:   </features>
Apr 11 21:52:32 user nova-compute[71364]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 21:52:32 user nova-compute[71364]:     <model fallback='forbid'>Nehalem</model>
Apr 11 21:52:32 user nova-compute[71364]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 21:52:32 user nova-compute[71364]:     <feature policy='require' name='vme'/>
Apr 11 21:52:32 user nova-compute[71364]:     <feature policy='require' name='x2apic'/>
Apr 11 21:52:32 user nova-compute[71364]:     <feature policy='require' name='hypervisor'/>
Apr 11 21:52:32 user nova-compute[71364]:   </cpu>
Apr 11 21:52:32 user nova-compute[71364]:   <clock offset='utc'>
Apr 11 21:52:32 user nova-compute[71364]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 21:52:32 user nova-compute[71364]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 21:52:32 user nova-compute[71364]:     <timer name='hpet' present='no'/>
Apr 11 21:52:32 user nova-compute[71364]:   </clock>
Apr 11 21:52:32 user nova-compute[71364]:   <on_poweroff>destroy</on_poweroff>
Apr 11 21:52:32 user nova-compute[71364]:   <on_reboot>restart</on_reboot>
Apr 11 21:52:32 user nova-compute[71364]:   <on_crash>destroy</on_crash>
Apr 11 21:52:32 user nova-compute[71364]:   <devices>
Apr 11 21:52:32 user nova-compute[71364]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 21:52:32 user nova-compute[71364]:     <disk type='file' device='disk'>
Apr 11 21:52:32 user nova-compute[71364]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 21:52:32 user nova-compute[71364]:       <source file='/opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk' index='2'/>
Apr 11 21:52:32 user nova-compute[71364]:       <backingStore type='file' index='3'>
Apr 11 21:52:32 user nova-compute[71364]:         <format type='raw'/>
Apr 11 21:52:32 user nova-compute[71364]:         <source file='/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793'/>
Apr 11 21:52:32 user nova-compute[71364]:         <backingStore/>
Apr 11 21:52:32 user nova-compute[71364]:       </backingStore>
Apr 11 21:52:32 user nova-compute[71364]:       <target dev='vda' bus='virtio'/>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='virtio-disk0'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </disk>
Apr 11 21:52:32 user nova-compute[71364]:     <disk type='file' device='cdrom'>
Apr 11 21:52:32 user nova-compute[71364]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 21:52:32 user nova-compute[71364]:       <source file='/opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk.config' index='1'/>
Apr 11 21:52:32 user nova-compute[71364]:       <backingStore/>
Apr 11 21:52:32 user nova-compute[71364]:       <target dev='hda' bus='ide'/>
Apr 11 21:52:32 user nova-compute[71364]:       <readonly/>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='ide0-0-0'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </disk>
Apr 11 21:52:32 user nova-compute[71364]:     <controller type='usb' index='0' model='none'>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='usb'/>
Apr 11 21:52:32 user nova-compute[71364]:     </controller>
Apr 11 21:52:32 user nova-compute[71364]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='pci.0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </controller>
Apr 11 21:52:32 user nova-compute[71364]:     <controller type='ide' index='0'>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='ide'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 21:52:32 user nova-compute[71364]:     </controller>
Apr 11 21:52:32 user nova-compute[71364]:     <interface type='ethernet'>
Apr 11 21:52:32 user nova-compute[71364]:       <mac address='fa:16:3e:27:80:f5'/>
Apr 11 21:52:32 user nova-compute[71364]:       <target dev='tap875f44f1-12'/>
Apr 11 21:52:32 user nova-compute[71364]:       <model type='virtio'/>
Apr 11 21:52:32 user nova-compute[71364]:       <mtu size='1442'/>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='net0'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </interface>
Apr 11 21:52:32 user nova-compute[71364]:     <interface type='ethernet'>
Apr 11 21:52:32 user nova-compute[71364]:       <mac address='fa:16:3e:3b:65:b4'/>
Apr 11 21:52:32 user nova-compute[71364]:       <target dev='tap8067fe72-d5'/>
Apr 11 21:52:32 user nova-compute[71364]:       <model type='virtio'/>
Apr 11 21:52:32 user nova-compute[71364]:       <mtu size='1442'/>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='net1'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </interface>
Apr 11 21:52:32 user nova-compute[71364]:     <serial type='pty'>
Apr 11 21:52:32 user nova-compute[71364]:       <source path='/dev/pts/7'/>
Apr 11 21:52:32 user nova-compute[71364]:       <log file='/opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/console.log' append='off'/>
Apr 11 21:52:32 user nova-compute[71364]:       <target type='isa-serial' port='0'>
Apr 11 21:52:32 user nova-compute[71364]:         <model name='isa-serial'/>
Apr 11 21:52:32 user nova-compute[71364]:       </target>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='serial0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </serial>
Apr 11 21:52:32 user nova-compute[71364]:     <console type='pty' tty='/dev/pts/7'>
Apr 11 21:52:32 user nova-compute[71364]:       <source path='/dev/pts/7'/>
Apr 11 21:52:32 user nova-compute[71364]:       <log file='/opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/console.log' append='off'/>
Apr 11 21:52:32 user nova-compute[71364]:       <target type='serial' port='0'/>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='serial0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </console>
Apr 11 21:52:32 user nova-compute[71364]:     <input type='mouse' bus='ps2'>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='input0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </input>
Apr 11 21:52:32 user nova-compute[71364]:     <input type='keyboard' bus='ps2'>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='input1'/>
Apr 11 21:52:32 user nova-compute[71364]:     </input>
Apr 11 21:52:32 user nova-compute[71364]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 11 21:52:32 user nova-compute[71364]:       <listen type='address' address='0.0.0.0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </graphics>
Apr 11 21:52:32 user nova-compute[71364]:     <audio id='1' type='none'/>
Apr 11 21:52:32 user nova-compute[71364]:     <video>
Apr 11 21:52:32 user nova-compute[71364]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='video0'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </video>
Apr 11 21:52:32 user nova-compute[71364]:     <memballoon model='virtio'>
Apr 11 21:52:32 user nova-compute[71364]:       <stats period='10'/>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='balloon0'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </memballoon>
Apr 11 21:52:32 user nova-compute[71364]:     <rng model='virtio'>
Apr 11 21:52:32 user nova-compute[71364]:       <backend model='random'>/dev/urandom</backend>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='rng0'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </rng>
Apr 11 21:52:32 user nova-compute[71364]:   </devices>
Apr 11 21:52:32 user nova-compute[71364]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 21:52:32 user nova-compute[71364]:     <label>libvirt-335d5305-28e6-4766-b0b2-b56848ff8652</label>
Apr 11 21:52:32 user nova-compute[71364]:     <imagelabel>libvirt-335d5305-28e6-4766-b0b2-b56848ff8652</imagelabel>
Apr 11 21:52:32 user nova-compute[71364]:   </seclabel>
Apr 11 21:52:32 user nova-compute[71364]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 21:52:32 user nova-compute[71364]:     <label>+64055:+108</label>
Apr 11 21:52:32 user nova-compute[71364]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 21:52:32 user nova-compute[71364]:   </seclabel>
Apr 11 21:52:32 user nova-compute[71364]: </domain>
Apr 11 21:52:32 user nova-compute[71364]:  {{(pid=71364) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 21:52:32 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Successfully detached device tap8067fe72-d5 from instance 335d5305-28e6-4766-b0b2-b56848ff8652 from the persistent domain config.
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] (1/8): Attempting to detach device tap8067fe72-d5 with device alias net1 from instance 335d5305-28e6-4766-b0b2-b56848ff8652 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] detach device xml: <interface type="ethernet">
Apr 11 21:52:32 user nova-compute[71364]:   <mac address="fa:16:3e:3b:65:b4"/>
Apr 11 21:52:32 user nova-compute[71364]:   <model type="virtio"/>
Apr 11 21:52:32 user nova-compute[71364]:   <mtu size="1442"/>
Apr 11 21:52:32 user nova-compute[71364]:   <target dev="tap8067fe72-d5"/>
Apr 11 21:52:32 user nova-compute[71364]: </interface>
Apr 11 21:52:32 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyQXqOjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26135633066636163', 'path': '/dev/sde'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135633066636163', 'path': '/dev/sde'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.objects.instance [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lazy-loading 'flavor' on Instance uuid 5a3b5455-983c-4c30-b229-8922443af209 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-2a30db11-87fb-496d-a169-72201efe9485 req-0d4a28d2-2031-4463-a112-ae59b31788e7 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Received event network-vif-plugged-327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2a30db11-87fb-496d-a169-72201efe9485 req-0d4a28d2-2031-4463-a112-ae59b31788e7 service nova] Acquiring lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2a30db11-87fb-496d-a169-72201efe9485 req-0d4a28d2-2031-4463-a112-ae59b31788e7 service nova] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2a30db11-87fb-496d-a169-72201efe9485 req-0d4a28d2-2031-4463-a112-ae59b31788e7 service nova] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-2a30db11-87fb-496d-a169-72201efe9485 req-0d4a28d2-2031-4463-a112-ae59b31788e7 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] No waiting events found dispatching network-vif-plugged-327f645b-e31b-4f09-88d2-a53f8a29905c {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:32 user nova-compute[71364]: WARNING nova.compute.manager [req-2a30db11-87fb-496d-a169-72201efe9485 req-0d4a28d2-2031-4463-a112-ae59b31788e7 service nova] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Received unexpected event network-vif-plugged-327f645b-e31b-4f09-88d2-a53f8a29905c for instance with vm_state deleted and task_state None.
Apr 11 21:52:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681249952.4772103, 335d5305-28e6-4766-b0b2-b56848ff8652 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Start waiting for the detach event from libvirt for device tap8067fe72-d5 with device alias net1 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:3b:65:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8067fe72-d5"/></interface> {{(pid=71364) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:3b:65:b4"/><model type="virtio"/><mtu size="1442"/><target dev="tap8067fe72-d5"/></interface>not found in domain: <domain type='kvm' id='7'>
Apr 11 21:52:32 user nova-compute[71364]:   <name>instance-00000006</name>
Apr 11 21:52:32 user nova-compute[71364]:   <uuid>335d5305-28e6-4766-b0b2-b56848ff8652</uuid>
Apr 11 21:52:32 user nova-compute[71364]:   <metadata>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:52:32 user nova-compute[71364]:   <nova:package version="0.0.0"/>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:name>tempest-device-tagging-server-221002458</nova:name>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:creationTime>2023-04-11 21:52:19</nova:creationTime>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:flavor name="m1.nano">
Apr 11 21:52:32 user nova-compute[71364]:     <nova:memory>128</nova:memory>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:disk>1</nova:disk>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:swap>0</nova:swap>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:vcpus>1</nova:vcpus>
Apr 11 21:52:32 user nova-compute[71364]:   </nova:flavor>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:owner>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:user uuid="08dd18a54a074e658d08ca381e0c87ff">tempest-TaggedAttachmentsTest-2065530295-project-member</nova:user>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:project uuid="c2ba7063a25043fdb16f3e1f0c0c51d3">tempest-TaggedAttachmentsTest-2065530295</nova:project>
Apr 11 21:52:32 user nova-compute[71364]:   </nova:owner>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:ports>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:port uuid="875f44f1-120e-48bc-9742-662c6bb93332">
Apr 11 21:52:32 user nova-compute[71364]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 21:52:32 user nova-compute[71364]:     </nova:port>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:port uuid="8067fe72-d5ad-4344-9a80-490071a443e3">
Apr 11 21:52:32 user nova-compute[71364]:       <nova:ip type="fixed" address="10.10.10.127" ipVersion="4"/>
Apr 11 21:52:32 user nova-compute[71364]:     </nova:port>
Apr 11 21:52:32 user nova-compute[71364]:   </nova:ports>
Apr 11 21:52:32 user nova-compute[71364]: </nova:instance>
Apr 11 21:52:32 user nova-compute[71364]:   </metadata>
Apr 11 21:52:32 user nova-compute[71364]:   <memory unit='KiB'>131072</memory>
Apr 11 21:52:32 user nova-compute[71364]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 11 21:52:32 user nova-compute[71364]:   <vcpu placement='static'>1</vcpu>
Apr 11 21:52:32 user nova-compute[71364]:   <resource>
Apr 11 21:52:32 user nova-compute[71364]:     <partition>/machine</partition>
Apr 11 21:52:32 user nova-compute[71364]:   </resource>
Apr 11 21:52:32 user nova-compute[71364]:   <sysinfo type='smbios'>
Apr 11 21:52:32 user nova-compute[71364]:     <system>
Apr 11 21:52:32 user nova-compute[71364]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 11 21:52:32 user nova-compute[71364]:       <entry name='product'>OpenStack Nova</entry>
Apr 11 21:52:32 user nova-compute[71364]:       <entry name='version'>0.0.0</entry>
Apr 11 21:52:32 user nova-compute[71364]:       <entry name='serial'>335d5305-28e6-4766-b0b2-b56848ff8652</entry>
Apr 11 21:52:32 user nova-compute[71364]:       <entry name='uuid'>335d5305-28e6-4766-b0b2-b56848ff8652</entry>
Apr 11 21:52:32 user nova-compute[71364]:       <entry name='family'>Virtual Machine</entry>
Apr 11 21:52:32 user nova-compute[71364]:     </system>
Apr 11 21:52:32 user nova-compute[71364]:   </sysinfo>
Apr 11 21:52:32 user nova-compute[71364]:   <os>
Apr 11 21:52:32 user nova-compute[71364]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 11 21:52:32 user nova-compute[71364]:     <boot dev='hd'/>
Apr 11 21:52:32 user nova-compute[71364]:     <smbios mode='sysinfo'/>
Apr 11 21:52:32 user nova-compute[71364]:   </os>
Apr 11 21:52:32 user nova-compute[71364]:   <features>
Apr 11 21:52:32 user nova-compute[71364]:     <acpi/>
Apr 11 21:52:32 user nova-compute[71364]:     <apic/>
Apr 11 21:52:32 user nova-compute[71364]:     <vmcoreinfo state='on'/>
Apr 11 21:52:32 user nova-compute[71364]:   </features>
Apr 11 21:52:32 user nova-compute[71364]:   <cpu mode='custom' match='exact' check='full'>
Apr 11 21:52:32 user nova-compute[71364]:     <model fallback='forbid'>Nehalem</model>
Apr 11 21:52:32 user nova-compute[71364]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 11 21:52:32 user nova-compute[71364]:     <feature policy='require' name='vme'/>
Apr 11 21:52:32 user nova-compute[71364]:     <feature policy='require' name='x2apic'/>
Apr 11 21:52:32 user nova-compute[71364]:     <feature policy='require' name='hypervisor'/>
Apr 11 21:52:32 user nova-compute[71364]:   </cpu>
Apr 11 21:52:32 user nova-compute[71364]:   <clock offset='utc'>
Apr 11 21:52:32 user nova-compute[71364]:     <timer name='pit' tickpolicy='delay'/>
Apr 11 21:52:32 user nova-compute[71364]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 11 21:52:32 user nova-compute[71364]:     <timer name='hpet' present='no'/>
Apr 11 21:52:32 user nova-compute[71364]:   </clock>
Apr 11 21:52:32 user nova-compute[71364]:   <on_poweroff>destroy</on_poweroff>
Apr 11 21:52:32 user nova-compute[71364]:   <on_reboot>restart</on_reboot>
Apr 11 21:52:32 user nova-compute[71364]:   <on_crash>destroy</on_crash>
Apr 11 21:52:32 user nova-compute[71364]:   <devices>
Apr 11 21:52:32 user nova-compute[71364]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 11 21:52:32 user nova-compute[71364]:     <disk type='file' device='disk'>
Apr 11 21:52:32 user nova-compute[71364]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 11 21:52:32 user nova-compute[71364]:       <source file='/opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk' index='2'/>
Apr 11 21:52:32 user nova-compute[71364]:       <backingStore type='file' index='3'>
Apr 11 21:52:32 user nova-compute[71364]:         <format type='raw'/>
Apr 11 21:52:32 user nova-compute[71364]:         <source file='/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793'/>
Apr 11 21:52:32 user nova-compute[71364]:         <backingStore/>
Apr 11 21:52:32 user nova-compute[71364]:       </backingStore>
Apr 11 21:52:32 user nova-compute[71364]:       <target dev='vda' bus='virtio'/>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='virtio-disk0'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </disk>
Apr 11 21:52:32 user nova-compute[71364]:     <disk type='file' device='cdrom'>
Apr 11 21:52:32 user nova-compute[71364]:       <driver name='qemu' type='raw' cache='none'/>
Apr 11 21:52:32 user nova-compute[71364]:       <source file='/opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk.config' index='1'/>
Apr 11 21:52:32 user nova-compute[71364]:       <backingStore/>
Apr 11 21:52:32 user nova-compute[71364]:       <target dev='hda' bus='ide'/>
Apr 11 21:52:32 user nova-compute[71364]:       <readonly/>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='ide0-0-0'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </disk>
Apr 11 21:52:32 user nova-compute[71364]:     <controller type='usb' index='0' model='none'>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='usb'/>
Apr 11 21:52:32 user nova-compute[71364]:     </controller>
Apr 11 21:52:32 user nova-compute[71364]:     <controller type='pci' index='0' model='pci-root'>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='pci.0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </controller>
Apr 11 21:52:32 user nova-compute[71364]:     <controller type='ide' index='0'>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='ide'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 11 21:52:32 user nova-compute[71364]:     </controller>
Apr 11 21:52:32 user nova-compute[71364]:     <interface type='ethernet'>
Apr 11 21:52:32 user nova-compute[71364]:       <mac address='fa:16:3e:27:80:f5'/>
Apr 11 21:52:32 user nova-compute[71364]:       <target dev='tap875f44f1-12'/>
Apr 11 21:52:32 user nova-compute[71364]:       <model type='virtio'/>
Apr 11 21:52:32 user nova-compute[71364]:       <mtu size='1442'/>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='net0'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </interface>
Apr 11 21:52:32 user nova-compute[71364]:     <serial type='pty'>
Apr 11 21:52:32 user nova-compute[71364]:       <source path='/dev/pts/7'/>
Apr 11 21:52:32 user nova-compute[71364]:       <log file='/opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/console.log' append='off'/>
Apr 11 21:52:32 user nova-compute[71364]:       <target type='isa-serial' port='0'>
Apr 11 21:52:32 user nova-compute[71364]:         <model name='isa-serial'/>
Apr 11 21:52:32 user nova-compute[71364]:       </target>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='serial0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </serial>
Apr 11 21:52:32 user nova-compute[71364]:     <console type='pty' tty='/dev/pts/7'>
Apr 11 21:52:32 user nova-compute[71364]:       <source path='/dev/pts/7'/>
Apr 11 21:52:32 user nova-compute[71364]:       <log file='/opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/console.log' append='off'/>
Apr 11 21:52:32 user nova-compute[71364]:       <target type='serial' port='0'/>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='serial0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </console>
Apr 11 21:52:32 user nova-compute[71364]:     <input type='mouse' bus='ps2'>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='input0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </input>
Apr 11 21:52:32 user nova-compute[71364]:     <input type='keyboard' bus='ps2'>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='input1'/>
Apr 11 21:52:32 user nova-compute[71364]:     </input>
Apr 11 21:52:32 user nova-compute[71364]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 11 21:52:32 user nova-compute[71364]:       <listen type='address' address='0.0.0.0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </graphics>
Apr 11 21:52:32 user nova-compute[71364]:     <audio id='1' type='none'/>
Apr 11 21:52:32 user nova-compute[71364]:     <video>
Apr 11 21:52:32 user nova-compute[71364]:       <model type='virtio' heads='1' primary='yes'/>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='video0'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </video>
Apr 11 21:52:32 user nova-compute[71364]:     <memballoon model='virtio'>
Apr 11 21:52:32 user nova-compute[71364]:       <stats period='10'/>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='balloon0'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </memballoon>
Apr 11 21:52:32 user nova-compute[71364]:     <rng model='virtio'>
Apr 11 21:52:32 user nova-compute[71364]:       <backend model='random'>/dev/urandom</backend>
Apr 11 21:52:32 user nova-compute[71364]:       <alias name='rng0'/>
Apr 11 21:52:32 user nova-compute[71364]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 11 21:52:32 user nova-compute[71364]:     </rng>
Apr 11 21:52:32 user nova-compute[71364]:   </devices>
Apr 11 21:52:32 user nova-compute[71364]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 11 21:52:32 user nova-compute[71364]:     <label>libvirt-335d5305-28e6-4766-b0b2-b56848ff8652</label>
Apr 11 21:52:32 user nova-compute[71364]:     <imagelabel>libvirt-335d5305-28e6-4766-b0b2-b56848ff8652</imagelabel>
Apr 11 21:52:32 user nova-compute[71364]:   </seclabel>
Apr 11 21:52:32 user nova-compute[71364]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 11 21:52:32 user nova-compute[71364]:     <label>+64055:+108</label>
Apr 11 21:52:32 user nova-compute[71364]:     <imagelabel>+64055:+108</imagelabel>
Apr 11 21:52:32 user nova-compute[71364]:   </seclabel>
Apr 11 21:52:32 user nova-compute[71364]: </domain>
Apr 11 21:52:32 user nova-compute[71364]:  {{(pid=71364) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 11 21:52:32 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Successfully detached device tap8067fe72-d5 from instance 335d5305-28e6-4766-b0b2-b56848ff8652 from the live domain config.
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-221002458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-221002458',id=6,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9SP67fRzYDr8pH3V24PAo6C5dZmRotW5QhNbjR+STaXowwhPQJNMYnIBrtgPE8JNDkIhvyxuwrwGRJsSpYFrzFZJJ9OejIdMCTzPDQ0PbvVC018NQN2jkSZDBN+Zyluw==',key_name='tempest-keypair-156975459',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2ba7063a25043fdb16f3e1f0c0c51d3',ramdisk_id='',reservation_id='r-0l47ba19',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2065530295',owner_user_name='tempest-TaggedAttachmentsTest-2065530295-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08dd18a54a074e658d08ca381e0c87ff',uuid=335d5305-28e6-4766-b0b2-b56848ff8652,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8067fe72-d5ad-4344-9a80-490071a443e3", "address": "fa:16:3e:3b:65:b4", "network": {"id": "5bf0dd8c-7a68-47b4-ab73-667890d8353f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1014832824", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8067fe72-d5", "ovs_interfaceid": "8067fe72-d5ad-4344-9a80-490071a443e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Converting VIF {"id": "8067fe72-d5ad-4344-9a80-490071a443e3", "address": "fa:16:3e:3b:65:b4", "network": {"id": "5bf0dd8c-7a68-47b4-ab73-667890d8353f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1014832824", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8067fe72-d5", "ovs_interfaceid": "8067fe72-d5ad-4344-9a80-490071a443e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:65:b4,bridge_name='br-int',has_traffic_filtering=True,id=8067fe72-d5ad-4344-9a80-490071a443e3,network=Network(5bf0dd8c-7a68-47b4-ab73-667890d8353f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8067fe72-d5') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG os_vif [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:65:b4,bridge_name='br-int',has_traffic_filtering=True,id=8067fe72-d5ad-4344-9a80-490071a443e3,network=Network(5bf0dd8c-7a68-47b4-ab73-667890d8353f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8067fe72-d5') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8067fe72-d5, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:52:32 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Deleted allocations for instance f279b153-a1c9-46f5-a0c5-4574ab956ba8
Apr 11 21:52:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:32 user nova-compute[71364]: INFO os_vif [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:65:b4,bridge_name='br-int',has_traffic_filtering=True,id=8067fe72-d5ad-4344-9a80-490071a443e3,network=Network(5bf0dd8c-7a68-47b4-ab73-667890d8353f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8067fe72-d5')
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:52:32 user nova-compute[71364]:   <nova:package version="0.0.0"/>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:name>tempest-device-tagging-server-221002458</nova:name>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:creationTime>2023-04-11 21:52:32</nova:creationTime>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:flavor name="m1.nano">
Apr 11 21:52:32 user nova-compute[71364]:     <nova:memory>128</nova:memory>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:disk>1</nova:disk>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:swap>0</nova:swap>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:vcpus>1</nova:vcpus>
Apr 11 21:52:32 user nova-compute[71364]:   </nova:flavor>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:owner>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:user uuid="08dd18a54a074e658d08ca381e0c87ff">tempest-TaggedAttachmentsTest-2065530295-project-member</nova:user>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:project uuid="c2ba7063a25043fdb16f3e1f0c0c51d3">tempest-TaggedAttachmentsTest-2065530295</nova:project>
Apr 11 21:52:32 user nova-compute[71364]:   </nova:owner>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:52:32 user nova-compute[71364]:   <nova:ports>
Apr 11 21:52:32 user nova-compute[71364]:     <nova:port uuid="875f44f1-120e-48bc-9742-662c6bb93332">
Apr 11 21:52:32 user nova-compute[71364]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 11 21:52:32 user nova-compute[71364]:     </nova:port>
Apr 11 21:52:32 user nova-compute[71364]:   </nova:ports>
Apr 11 21:52:32 user nova-compute[71364]: </nova:instance>
Apr 11 21:52:32 user nova-compute[71364]:  {{(pid=71364) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "f279b153-a1c9-46f5-a0c5-4574ab956ba8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.597s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-209a39c5-9955-4545-8ead-bb333a4ddb46 req-063eff93-7b5a-4a85-91a7-6aa9033c27b7 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received event network-vif-unplugged-8067fe72-d5ad-4344-9a80-490071a443e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-209a39c5-9955-4545-8ead-bb333a4ddb46 req-063eff93-7b5a-4a85-91a7-6aa9033c27b7 service nova] Acquiring lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-209a39c5-9955-4545-8ead-bb333a4ddb46 req-063eff93-7b5a-4a85-91a7-6aa9033c27b7 service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-209a39c5-9955-4545-8ead-bb333a4ddb46 req-063eff93-7b5a-4a85-91a7-6aa9033c27b7 service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-209a39c5-9955-4545-8ead-bb333a4ddb46 req-063eff93-7b5a-4a85-91a7-6aa9033c27b7 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] No waiting events found dispatching network-vif-unplugged-8067fe72-d5ad-4344-9a80-490071a443e3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:32 user nova-compute[71364]: WARNING nova.compute.manager [req-209a39c5-9955-4545-8ead-bb333a4ddb46 req-063eff93-7b5a-4a85-91a7-6aa9033c27b7 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received unexpected event network-vif-unplugged-8067fe72-d5ad-4344-9a80-490071a443e3 for instance with vm_state active and task_state None.
Apr 11 21:52:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:52:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquired lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:52:33 user nova-compute[71364]: DEBUG nova.network.neutron [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:52:33 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 125829120 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:33 user nova-compute[71364]: INFO nova.network.neutron [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Port 8067fe72-d5ad-4344-9a80-490071a443e3 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 11 21:52:33 user nova-compute[71364]: DEBUG nova.network.neutron [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Updating instance_info_cache with network_info: [{"id": "875f44f1-120e-48bc-9742-662c6bb93332", "address": "fa:16:3e:27:80:f5", "network": {"id": "35eb0a23-469f-4f8a-8c16-1cea8207fd79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1614521033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875f44f1-12", "ovs_interfaceid": "875f44f1-120e-48bc-9742-662c6bb93332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:52:33 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 292552704 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Releasing lock "refresh_cache-335d5305-28e6-4766-b0b2-b56848ff8652" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:52:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "interface-335d5305-28e6-4766-b0b2-b56848ff8652-8067fe72-d5ad-4344-9a80-490071a443e3" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.683s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:34 user nova-compute[71364]: DEBUG nova.compute.manager [req-cc04fe15-711e-4c62-a17e-831a9cd38210 req-93537d89-94b4-4487-8803-5d5d0278c1d0 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received event network-vif-deleted-8067fe72-d5ad-4344-9a80-490071a443e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 450887680 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:34 user nova-compute[71364]: DEBUG nova.compute.manager [req-b12b2e46-8f2b-4810-a838-b56436033074 req-85de2b44-342e-4651-9645-855999b67443 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received event network-vif-plugged-8067fe72-d5ad-4344-9a80-490071a443e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b12b2e46-8f2b-4810-a838-b56436033074 req-85de2b44-342e-4651-9645-855999b67443 service nova] Acquiring lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b12b2e46-8f2b-4810-a838-b56436033074 req-85de2b44-342e-4651-9645-855999b67443 service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b12b2e46-8f2b-4810-a838-b56436033074 req-85de2b44-342e-4651-9645-855999b67443 service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:34 user nova-compute[71364]: DEBUG nova.compute.manager [req-b12b2e46-8f2b-4810-a838-b56436033074 req-85de2b44-342e-4651-9645-855999b67443 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] No waiting events found dispatching network-vif-plugged-8067fe72-d5ad-4344-9a80-490071a443e3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:34 user nova-compute[71364]: WARNING nova.compute.manager [req-b12b2e46-8f2b-4810-a838-b56436033074 req-85de2b44-342e-4651-9645-855999b67443 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received unexpected event network-vif-plugged-8067fe72-d5ad-4344-9a80-490071a443e3 for instance with vm_state active and task_state None.
Apr 11 21:52:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 649068544 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:35 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 846200832 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:35 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 1054867456 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XltckDeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:36 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d8f5fa-c3a3-4e63-b22f-68a99df6dd04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:52:36 user nova-compute[71364]: No targets found.
Apr 11 21:52:36 user nova-compute[71364]: iSNS:
Apr 11 21:52:36 user nova-compute[71364]: No targets found.
Apr 11 21:52:36 user nova-compute[71364]: STATIC:
Apr 11 21:52:36 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540
Apr 11 21:52:36 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:36 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:36 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9
Apr 11 21:52:36 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:36 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:36 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e
Apr 11 21:52:36 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:36 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:36 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973
Apr 11 21:52:36 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:36 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:36 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9
Apr 11 21:52:36 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:36 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:36 user nova-compute[71364]: FIRMWARE:
Apr 11 21:52:36 user nova-compute[71364]: No targets found.
Apr 11 21:52:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:52:36 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:52:36 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[22917012-13a5-4d01-a33c-83afdc0fb504]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18f9d74-dc2e-4433-92ae-7f4d7c326b29]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)
Apr 11 21:52:36 user nova-compute[71364]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:36 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:36 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:36 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)
Apr 11 21:52:36 user nova-compute[71364]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:36 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:36 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:36 user nova-compute[71364]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bd079b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9'): ({'sdf'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Removing single pathed devices sdf {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[30535c82-b700-4232-9cf3-2989881cbc4c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2635412a-2aa1-4d78-b61c-0ae7f1c940de]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Flushing IO for device /dev/sdf {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f6310d-3c5f-4250-8dc8-58279b22ae85]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[decd30e8-c1ff-4537-824f-4a03e11eb6cf]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] SCSI volumes sdf have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da43dfc-b29f-4ec5-91bf-63d6f2995e50]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d488aca-81a9-4b5e-a8ef-f1ba7a35a060]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260]
Apr 11 21:52:36 user nova-compute[71364]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6abedde-0a16-461e-931c-fd685334fa8c]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] <== disconnect_volume: return (299ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyQXqOjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '5a3b5455-983c-4c30-b229-8922443af209', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9470c4c-3635-41c7-96df-24125ae941a9', 'serial'} {{(pid=71364) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 11 21:52:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] swap_volume: removing Cinder connection for volume d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 {{(pid=71364) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 11 21:52:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] swap_volume: Updating volume d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "pyQXqOjS", "auth_password": "pGlXW3tdI4xvVq", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "b9470c4c-3635-41c7-96df-24125ae941a9"}, "status": "reserved", "instance": "5a3b5455-983c-4c30-b229-8922443af209", "attached_at": "", "detached_at": "", "volume_id": "b9470c4c-3635-41c7-96df-24125ae941a9", "serial": "b9470c4c-3635-41c7-96df-24125ae941a9"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b9470c4c-3635-41c7-96df-24125ae941a9', 'no_device': None, 'attachment_id': '514daf72-f895-4695-8f23-46a5eb591a08'} {{(pid=71364) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 11 21:52:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "5a3b5455-983c-4c30-b229-8922443af209" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.361s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Acquiring lock "5a3b5455-983c-4c30-b229-8922443af209" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "5a3b5455-983c-4c30-b229-8922443af209" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG os_brick.utils [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5102ec9f-1aa6-4c5e-82b6-832c27d8713f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[83985e7f-19c6-485b-b909-fdbffcaf3d27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ab72d2-7564-4459-b64a-0fd1ecdc194d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[082136a8-e4bd-4875-9781-e7e6eff3086e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:52:38 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:52:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77dc20f-a8d3-4a87-a72e-291f6cab0510]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:52:38 user nova-compute[71364]: DEBUG os_brick.utils [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:39 user nova-compute[71364]: INFO nova.compute.manager [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Swapping volume b9470c4c-3635-41c7-96df-24125ae941a9 for d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9
Apr 11 21:52:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XltckDeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a3b5455-983c-4c30-b229-8922443af209', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 'serial': 'd1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyQXqOjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'b9470c4c-3635-41c7-96df-24125ae941a9'}, 'status': 'reserved', 'instance': '5a3b5455-983c-4c30-b229-8922443af209', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9470c4c-3635-41c7-96df-24125ae941a9', 'serial'} {{(pid=71364) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XltckDeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:43 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:43 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:43 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[caab1b81-34d4-4acf-876a-b297d96344ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:52:43 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91c5251-09fb-4963-85be-01e56ae6fc8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9] added
Apr 11 21:52:43 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c75f3ff-3c55-4835-9187-f5ed03c88bee]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5697aa99-99e2-4171-92cd-3c6a582c35c5]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XltckDeG {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XltckDeG" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfa8a46-d696-439e-a226-bfc56a93cadc]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XltckDeG'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cbde14-c145-4328-ae82-40d16d7aa809]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7b438d-dae6-4574-8506-ee26da29614b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)
Apr 11 21:52:43 user nova-compute[71364]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:43 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:43 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:43 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)
Apr 11 21:52:43 user nova-compute[71364]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:43 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:43 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:43 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfd8c6e-9cbd-4436-a15a-b14bdbc977dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260]
Apr 11 21:52:43 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:43 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4b14df-4fe0-48bd-b2ac-7ab5ab67c9a8]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b15fa53-5b55-4370-9ea4-ff0d323751dc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)
Apr 11 21:52:43 user nova-compute[71364]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:43 user nova-compute[71364]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:43 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:43 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:43 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)
Apr 11 21:52:43 user nova-compute[71364]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:43 user nova-compute[71364]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:43 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:43 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:43 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5afe20-0567-411c-b89c-4aa9b2ac4af3]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XltckDeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:52:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23833616638633364', 'path': '/dev/sdf'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833616638633364', 'path': '/dev/sdf'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:52:44 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lazy-loading 'flavor' on Instance uuid 5a3b5455-983c-4c30-b229-8922443af209 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 144703488 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 319815680 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:45 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681249950.8244274, f279b153-a1c9-46f5-a0c5-4574ab956ba8 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:52:45 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] VM Stopped (Lifecycle Event)
Apr 11 21:52:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c1359776-9dbf-4964-a04b-0267dabc996b None None] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:52:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 505413632 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 683671552 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 848297984 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 1022361600 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pyQXqOjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'b9470c4c-3635-41c7-96df-24125ae941a9': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:48 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cdf0cb-699b-4a64-88f3-0b029130afda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:52:48 user nova-compute[71364]: No targets found.
Apr 11 21:52:48 user nova-compute[71364]: iSNS:
Apr 11 21:52:48 user nova-compute[71364]: No targets found.
Apr 11 21:52:48 user nova-compute[71364]: STATIC:
Apr 11 21:52:48 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540
Apr 11 21:52:48 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:48 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:48 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9
Apr 11 21:52:48 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:48 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:48 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e
Apr 11 21:52:48 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:48 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:48 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973
Apr 11 21:52:48 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:48 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:48 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9
Apr 11 21:52:48 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:48 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:48 user nova-compute[71364]: FIRMWARE:
Apr 11 21:52:48 user nova-compute[71364]: No targets found.
Apr 11 21:52:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:52:48 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:52:48 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3feb68a-3a1c-42d6-b955-8a455b24906d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e94a5e-d382-40d0-9045-ccb951ac8fd1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)
Apr 11 21:52:48 user nova-compute[71364]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:48 user nova-compute[71364]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:48 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:48 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 (non-flash)
Apr 11 21:52:48 user nova-compute[71364]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:48 user nova-compute[71364]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:48 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:48 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff7a24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9'): ({'sde'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Removing single pathed devices sde {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d13d0a-ebb8-4a4a-a791-b2b4d3961415]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cac37f-310e-41c0-b64a-da22c70f0cad]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Flushing IO for device /dev/sde {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[94329829-854b-4cfd-9e59-f370f67d13c9]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8577d6-4e8c-4e80-8f94-bced921e0dd4]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5a00fc-2568-499a-b046-603bb195ba09]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e48f76a-d01c-4173-8369-d2dcbdc7cedf]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9, portal: 172.16.0.220,3260]
Apr 11 21:52:48 user nova-compute[71364]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9470c4c-3635-41c7-96df-24125ae941a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9037e9-bc59-40fd-b681-8b1d7e9961d3]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] <== disconnect_volume: return (307ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updating instance_info_cache with network_info: [{"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XltckDeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '5a3b5455-983c-4c30-b229-8922443af209', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 'serial'} {{(pid=71364) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 11 21:52:48 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] swap_volume: removing Cinder connection for volume b9470c4c-3635-41c7-96df-24125ae941a9 {{(pid=71364) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 11 21:52:49 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:52:49 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:52:49 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] swap_volume: Updating volume b9470c4c-3635-41c7-96df-24125ae941a9 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "XltckDeG", "auth_password": "CwtgA8Pxd7YzTs", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9"}, "status": "reserved", "instance": "5a3b5455-983c-4c30-b229-8922443af209", "attached_at": "", "detached_at": "", "volume_id": "d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9", "serial": "d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 'no_device': None, 'attachment_id': 'c2e8eb16-e1da-478b-bd5d-457698c80d8d'} {{(pid=71364) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 11 21:52:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "5a3b5455-983c-4c30-b229-8922443af209" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 10.860s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "5a3b5455-983c-4c30-b229-8922443af209" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "5a3b5455-983c-4c30-b229-8922443af209" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:51 user nova-compute[71364]: INFO nova.compute.manager [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Detaching volume d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: INFO nova.virt.block_device [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Attempting to driver detach volume d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 from mountpoint /dev/vdb
Apr 11 21:52:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Attempting to detach device vdb from instance 5a3b5455-983c-4c30-b229-8922443af209 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:52:51 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:52:51 user nova-compute[71364]:   <source dev="/dev/sdf"/>
Apr 11 21:52:51 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:52:51 user nova-compute[71364]:   <serial>d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9</serial>
Apr 11 21:52:51 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:52:51 user nova-compute[71364]: </disk>
Apr 11 21:52:51 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:52:51 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Successfully detached device vdb from instance 5a3b5455-983c-4c30-b229-8922443af209 from the persistent domain config.
Apr 11 21:52:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a3b5455-983c-4c30-b229-8922443af209 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:52:51 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:52:51 user nova-compute[71364]:   <source dev="/dev/sdf"/>
Apr 11 21:52:51 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:52:51 user nova-compute[71364]:   <serial>d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9</serial>
Apr 11 21:52:51 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:52:51 user nova-compute[71364]: </disk>
Apr 11 21:52:51 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-4a67fcf3-04d5-41d4-8d0a-6ca0e777a0da req-a2a75d1d-9383-48d6-b799-180f4f4bf29b service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-changed-4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-4a67fcf3-04d5-41d4-8d0a-6ca0e777a0da req-a2a75d1d-9383-48d6-b799-180f4f4bf29b service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing instance network info cache due to event network-changed-4bab3701-cae5-4cde-a61d-d4a11308c5bc. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a67fcf3-04d5-41d4-8d0a-6ca0e777a0da req-a2a75d1d-9383-48d6-b799-180f4f4bf29b service nova] Acquiring lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a67fcf3-04d5-41d4-8d0a-6ca0e777a0da req-a2a75d1d-9383-48d6-b799-180f4f4bf29b service nova] Acquired lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG nova.network.neutron [req-4a67fcf3-04d5-41d4-8d0a-6ca0e777a0da req-a2a75d1d-9383-48d6-b799-180f4f4bf29b service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Refreshing network info cache for port 4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681249971.7507415, 5a3b5455-983c-4c30-b229-8922443af209 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a3b5455-983c-4c30-b229-8922443af209 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:52:51 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Successfully detached device vdb from instance 5a3b5455-983c-4c30-b229-8922443af209 from the live domain config.
Apr 11 21:52:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XltckDeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'd1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:51 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e405fb-8bbd-4321-8ba6-febe9a276adf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:52:51 user nova-compute[71364]: No targets found.
Apr 11 21:52:51 user nova-compute[71364]: iSNS:
Apr 11 21:52:51 user nova-compute[71364]: No targets found.
Apr 11 21:52:51 user nova-compute[71364]: STATIC:
Apr 11 21:52:51 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540
Apr 11 21:52:51 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:51 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:51 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e
Apr 11 21:52:51 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:51 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:51 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973
Apr 11 21:52:51 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:51 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:51 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9
Apr 11 21:52:51 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:51 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:51 user nova-compute[71364]: FIRMWARE:
Apr 11 21:52:51 user nova-compute[71364]: No targets found.
Apr 11 21:52:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:52:51 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:52:51 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aab78f-e215-407f-9d51-dc89eeb4e2f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbad4385-9cc8-4c29-9d8b-b26b983ac3cb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:51 user nova-compute[71364]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:51 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:51 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 (non-flash)
Apr 11 21:52:51 user nova-compute[71364]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:51 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:51 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff757ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9'): ({'sdf'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Removing single pathed devices sdf {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d634082a-383f-4fed-86fa-1b4c72c1384e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1d0876-49a6-47ab-8147-b9bfab8cd54e]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Flushing IO for device /dev/sdf {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7582cfc8-ad37-43f8-aa8f-a71b5cd55e7e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3630db-b778-48fa-83f1-f2c21192e775]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] SCSI volumes sdf have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[22483d31-c6c2-440e-ad4b-bc0151a03c10]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dd611a-26aa-47f1-a918-f70b5418c80d]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260]
Apr 11 21:52:52 user nova-compute[71364]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:52 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[73968692-5acf-42ca-8260-f473fa93e381]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] <== disconnect_volume: return (421ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.network.neutron [req-4a67fcf3-04d5-41d4-8d0a-6ca0e777a0da req-a2a75d1d-9383-48d6-b799-180f4f4bf29b service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updated VIF entry in instance network info cache for port 4bab3701-cae5-4cde-a61d-d4a11308c5bc. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.network.neutron [req-4a67fcf3-04d5-41d4-8d0a-6ca0e777a0da req-a2a75d1d-9383-48d6-b799-180f4f4bf29b service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updating instance_info_cache with network_info: [{"id": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "address": "fa:16:3e:08:e9:e5", "network": {"id": "fe19ecab-8008-4c75-b42c-893bf768d60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366505631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bab3701-ca", "ovs_interfaceid": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053d127e-a3d3-40dd-92bb-c01cd0580309", "address": "fa:16:3e:fc:20:36", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053d127e-a3", "ovs_interfaceid": "053d127e-a3d3-40dd-92bb-c01cd0580309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "address": "fa:16:3e:84:11:12", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5ac2a-47", "ovs_interfaceid": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "address": "fa:16:3e:de:5c:a4", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84178c3a-ce", "ovs_interfaceid": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "address": "fa:16:3e:11:2c:22", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb863f6b5-96", "ovs_interfaceid": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "address": "fa:16:3e:5d:35:f8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2155540f-70", "ovs_interfaceid": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "address": "fa:16:3e:68:6d:d8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc8f7a5-1b", "ovs_interfaceid": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.objects.instance [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lazy-loading 'flavor' on Instance uuid 5a3b5455-983c-4c30-b229-8922443af209 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:53 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:52:53 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7791MB free_disk=26.441974639892578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a67fcf3-04d5-41d4-8d0a-6ca0e777a0da req-a2a75d1d-9383-48d6-b799-180f4f4bf29b service nova] Releasing lock "refresh_cache-b38bd805-2d70-441e-8853-73d4e092f4dc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "5a3b5455-983c-4c30-b229-8922443af209" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.026s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance e627de16-3a8f-4510-8001-0e57a272b859 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 335d5305-28e6-4766-b0b2-b56848ff8652 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5a3b5455-983c-4c30-b229-8922443af209 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b38bd805-2d70-441e-8853-73d4e092f4dc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76315af2-c4b9-4ad5-98ea-81826524d63e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d9341aca-d5c9-4c23-b8de-adb5360721bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:53 user nova-compute[71364]: INFO nova.compute.manager [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Terminating instance
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-3d9279d4-e958-4153-8ada-2305433f5ef6 req-c1a587f7-4ebc-4399-927d-0c0bea52d9fa service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-unplugged-4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3d9279d4-e958-4153-8ada-2305433f5ef6 req-c1a587f7-4ebc-4399-927d-0c0bea52d9fa service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3d9279d4-e958-4153-8ada-2305433f5ef6 req-c1a587f7-4ebc-4399-927d-0c0bea52d9fa service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3d9279d4-e958-4153-8ada-2305433f5ef6 req-c1a587f7-4ebc-4399-927d-0c0bea52d9fa service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-3d9279d4-e958-4153-8ada-2305433f5ef6 req-c1a587f7-4ebc-4399-927d-0c0bea52d9fa service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-unplugged-4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-3d9279d4-e958-4153-8ada-2305433f5ef6 req-c1a587f7-4ebc-4399-927d-0c0bea52d9fa service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-unplugged-4bab3701-cae5-4cde-a61d-d4a11308c5bc for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-5a5ff510-67de-4789-964d-9180c2678d42 req-cdc7bd80-697e-4d76-934a-2aa0f2264663 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-unplugged-7ff5ac2a-47b8-4a4e-9391-409086855c84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5a5ff510-67de-4789-964d-9180c2678d42 req-cdc7bd80-697e-4d76-934a-2aa0f2264663 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5a5ff510-67de-4789-964d-9180c2678d42 req-cdc7bd80-697e-4d76-934a-2aa0f2264663 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5a5ff510-67de-4789-964d-9180c2678d42 req-cdc7bd80-697e-4d76-934a-2aa0f2264663 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-5a5ff510-67de-4789-964d-9180c2678d42 req-cdc7bd80-697e-4d76-934a-2aa0f2264663 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-unplugged-7ff5ac2a-47b8-4a4e-9391-409086855c84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-5a5ff510-67de-4789-964d-9180c2678d42 req-cdc7bd80-697e-4d76-934a-2aa0f2264663 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-unplugged-7ff5ac2a-47b8-4a4e-9391-409086855c84 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-0f139f38-e474-466c-95a7-655fabf3c8dc req-70f1a723-e635-4420-9510-e2087b8aa7a7 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-unplugged-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0f139f38-e474-466c-95a7-655fabf3c8dc req-70f1a723-e635-4420-9510-e2087b8aa7a7 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0f139f38-e474-466c-95a7-655fabf3c8dc req-70f1a723-e635-4420-9510-e2087b8aa7a7 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0f139f38-e474-466c-95a7-655fabf3c8dc req-70f1a723-e635-4420-9510-e2087b8aa7a7 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-0f139f38-e474-466c-95a7-655fabf3c8dc req-70f1a723-e635-4420-9510-e2087b8aa7a7 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-unplugged-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-0f139f38-e474-466c-95a7-655fabf3c8dc req-70f1a723-e635-4420-9510-e2087b8aa7a7 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-unplugged-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Instance destroyed successfully.
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.objects.instance [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lazy-loading 'resources' on Instance uuid b38bd805-2d70-441e-8853-73d4e092f4dc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:51:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "address": "fa:16:3e:08:e9:e5", "network": {"id": "fe19ecab-8008-4c75-b42c-893bf768d60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366505631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bab3701-ca", "ovs_interfaceid": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "address": "fa:16:3e:08:e9:e5", "network": {"id": "fe19ecab-8008-4c75-b42c-893bf768d60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366505631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bab3701-ca", "ovs_interfaceid": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=4bab3701-cae5-4cde-a61d-d4a11308c5bc,network=Network(fe19ecab-8008-4c75-b42c-893bf768d60b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bab3701-ca') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=4bab3701-cae5-4cde-a61d-d4a11308c5bc,network=Network(fe19ecab-8008-4c75-b42c-893bf768d60b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bab3701-ca') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bab3701-ca, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: INFO os_vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:e9:e5,bridge_name='br-int',has_traffic_filtering=True,id=4bab3701-cae5-4cde-a61d-d4a11308c5bc,network=Network(fe19ecab-8008-4c75-b42c-893bf768d60b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bab3701-ca')
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:51:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "053d127e-a3d3-40dd-92bb-c01cd0580309", "address": "fa:16:3e:fc:20:36", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053d127e-a3", "ovs_interfaceid": "053d127e-a3d3-40dd-92bb-c01cd0580309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "053d127e-a3d3-40dd-92bb-c01cd0580309", "address": "fa:16:3e:fc:20:36", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053d127e-a3", "ovs_interfaceid": "053d127e-a3d3-40dd-92bb-c01cd0580309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:20:36,bridge_name='br-int',has_traffic_filtering=True,id=053d127e-a3d3-40dd-92bb-c01cd0580309,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap053d127e-a3') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:20:36,bridge_name='br-int',has_traffic_filtering=True,id=053d127e-a3d3-40dd-92bb-c01cd0580309,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap053d127e-a3') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap053d127e-a3, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: INFO os_vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:20:36,bridge_name='br-int',has_traffic_filtering=True,id=053d127e-a3d3-40dd-92bb-c01cd0580309,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap053d127e-a3')
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:51:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "address": "fa:16:3e:84:11:12", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5ac2a-47", "ovs_interfaceid": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "address": "fa:16:3e:84:11:12", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5ac2a-47", "ovs_interfaceid": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:11:12,bridge_name='br-int',has_traffic_filtering=True,id=7ff5ac2a-47b8-4a4e-9391-409086855c84,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ff5ac2a-47') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:11:12,bridge_name='br-int',has_traffic_filtering=True,id=7ff5ac2a-47b8-4a4e-9391-409086855c84,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ff5ac2a-47') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ff5ac2a-47, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: INFO os_vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:11:12,bridge_name='br-int',has_traffic_filtering=True,id=7ff5ac2a-47b8-4a4e-9391-409086855c84,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7ff5ac2a-47')
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:51:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "address": "fa:16:3e:de:5c:a4", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84178c3a-ce", "ovs_interfaceid": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "address": "fa:16:3e:de:5c:a4", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84178c3a-ce", "ovs_interfaceid": "84178c3a-ce1d-40e5-a8df-b01039c2e595", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:5c:a4,bridge_name='br-int',has_traffic_filtering=True,id=84178c3a-ce1d-40e5-a8df-b01039c2e595,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84178c3a-ce') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:5c:a4,bridge_name='br-int',has_traffic_filtering=True,id=84178c3a-ce1d-40e5-a8df-b01039c2e595,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84178c3a-ce') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84178c3a-ce, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: INFO os_vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:5c:a4,bridge_name='br-int',has_traffic_filtering=True,id=84178c3a-ce1d-40e5-a8df-b01039c2e595,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84178c3a-ce')
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:51:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "address": "fa:16:3e:11:2c:22", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb863f6b5-96", "ovs_interfaceid": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "address": "fa:16:3e:11:2c:22", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb863f6b5-96", "ovs_interfaceid": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:2c:22,bridge_name='br-int',has_traffic_filtering=True,id=b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb863f6b5-96') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:2c:22,bridge_name='br-int',has_traffic_filtering=True,id=b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb863f6b5-96') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb863f6b5-96, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: INFO os_vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:2c:22,bridge_name='br-int',has_traffic_filtering=True,id=b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7,network=Network(5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb863f6b5-96')
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:51:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "address": "fa:16:3e:5d:35:f8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2155540f-70", "ovs_interfaceid": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "address": "fa:16:3e:5d:35:f8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2155540f-70", "ovs_interfaceid": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:35:f8,bridge_name='br-int',has_traffic_filtering=True,id=2155540f-70ef-4d55-80dd-9f75bcd29afc,network=Network(0d00e759-61ae-4b5a-81a5-dda1e2ba7670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2155540f-70') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:35:f8,bridge_name='br-int',has_traffic_filtering=True,id=2155540f-70ef-4d55-80dd-9f75bcd29afc,network=Network(0d00e759-61ae-4b5a-81a5-dda1e2ba7670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2155540f-70') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2155540f-70, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: INFO os_vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:35:f8,bridge_name='br-int',has_traffic_filtering=True,id=2155540f-70ef-4d55-80dd-9f75bcd29afc,network=Network(0d00e759-61ae-4b5a-81a5-dda1e2ba7670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2155540f-70')
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1787126394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1787126394',id=9,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ==',key_name='tempest-keypair-63688282',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:51:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b6c690214fc4667b617cc760c352b30',ramdisk_id='',reservation_id='r-06c1bpvt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1290793725',owner_user_name='tempest-TaggedBootDevicesTest_v242-1290793725-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa98b435fa2346b880bef8fe46614ba4',uuid=b38bd805-2d70-441e-8853-73d4e092f4dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "address": "fa:16:3e:68:6d:d8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc8f7a5-1b", "ovs_interfaceid": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converting VIF {"id": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "address": "fa:16:3e:68:6d:d8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc8f7a5-1b", "ovs_interfaceid": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:6d:d8,bridge_name='br-int',has_traffic_filtering=True,id=fdc8f7a5-1b0e-4564-a0c7-106abb209b20,network=Network(0d00e759-61ae-4b5a-81a5-dda1e2ba7670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc8f7a5-1b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:6d:d8,bridge_name='br-int',has_traffic_filtering=True,id=fdc8f7a5-1b0e-4564-a0c7-106abb209b20,network=Network(0d00e759-61ae-4b5a-81a5-dda1e2ba7670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc8f7a5-1b') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdc8f7a5-1b, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: INFO os_vif [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:6d:d8,bridge_name='br-int',has_traffic_filtering=True,id=fdc8f7a5-1b0e-4564-a0c7-106abb209b20,network=Network(0d00e759-61ae-4b5a-81a5-dda1e2ba7670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdc8f7a5-1b')
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzfpdhUs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:55 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f31ae5e-034a-4ead-8e52-2469973bf368]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:52:55 user nova-compute[71364]: No targets found.
Apr 11 21:52:55 user nova-compute[71364]: iSNS:
Apr 11 21:52:55 user nova-compute[71364]: No targets found.
Apr 11 21:52:55 user nova-compute[71364]: STATIC:
Apr 11 21:52:55 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540
Apr 11 21:52:55 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:55 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:55 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e
Apr 11 21:52:55 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:55 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:55 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973
Apr 11 21:52:55 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:55 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:55 user nova-compute[71364]: FIRMWARE:
Apr 11 21:52:55 user nova-compute[71364]: No targets found.
Apr 11 21:52:55 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:52:55 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:52:55 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b4dcd8-ee42-4b86-8811-7e09d8d53411]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d13d75f-98dd-4d3b-aa96-5209ecd8bafa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:55 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:55 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:55 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e (non-flash)
Apr 11 21:52:55 user nova-compute[71364]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:55 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:55 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff7a1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2eda4e-4cfe-4908-8894-1869adc2657b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[46704640-5277-4930-a54b-7c06ffe22ac9]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0961ac02-6c23-47dd-aea1-42db5fcb77cd]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f821d3-8e61-438e-bc18-4d311999d2fa]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5279bd44-3c5c-44ce-8107-6cbe8de56023]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ccb109-444d-46ae-a32e-126135de54a6]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e, portal: 172.16.0.220,3260]
Apr 11 21:52:55 user nova-compute[71364]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:55 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4d6272-d5c9-4230-bfae-3cc02e26769e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8127532-44b6-48a5-9e26-5475f5772a45]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] <== disconnect_volume: return (293ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIgxfeZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:55 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb29797e-a094-455b-9101-2853328657c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:52:55 user nova-compute[71364]: No targets found.
Apr 11 21:52:55 user nova-compute[71364]: iSNS:
Apr 11 21:52:55 user nova-compute[71364]: No targets found.
Apr 11 21:52:55 user nova-compute[71364]: STATIC:
Apr 11 21:52:55 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540
Apr 11 21:52:55 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:55 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:55 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973
Apr 11 21:52:55 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:55 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:55 user nova-compute[71364]: FIRMWARE:
Apr 11 21:52:55 user nova-compute[71364]: No targets found.
Apr 11 21:52:55 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:52:55 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:52:55 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e2b778-41d3-4bc1-9b93-5e1a4094d744]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[98601ec4-ec5e-400c-8753-645c8a2aa4a5]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:55 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:55 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 (non-flash)
Apr 11 21:52:55 user nova-compute[71364]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:55 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff755cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973'): ({'sdc'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Removing single pathed devices sdc {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:55 user nova-compute[71364]: WARNING nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-4bab3701-cae5-4cde-a61d-d4a11308c5bc for instance with vm_state active and task_state deleting.
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-unplugged-053d127e-a3d3-40dd-92bb-c01cd0580309 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-unplugged-053d127e-a3d3-40dd-92bb-c01cd0580309 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-unplugged-053d127e-a3d3-40dd-92bb-c01cd0580309 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-053d127e-a3d3-40dd-92bb-c01cd0580309 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:55 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-053d127e-a3d3-40dd-92bb-c01cd0580309 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:55 user nova-compute[71364]: WARNING nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-053d127e-a3d3-40dd-92bb-c01cd0580309 for instance with vm_state active and task_state deleting.
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-unplugged-84178c3a-ce1d-40e5-a8df-b01039c2e595 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-unplugged-84178c3a-ce1d-40e5-a8df-b01039c2e595 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-unplugged-84178c3a-ce1d-40e5-a8df-b01039c2e595 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-84178c3a-ce1d-40e5-a8df-b01039c2e595 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-84178c3a-ce1d-40e5-a8df-b01039c2e595 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:56 user nova-compute[71364]: WARNING nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-84178c3a-ce1d-40e5-a8df-b01039c2e595 for instance with vm_state active and task_state deleting.
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-unplugged-fdc8f7a5-1b0e-4564-a0c7-106abb209b20 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-unplugged-fdc8f7a5-1b0e-4564-a0c7-106abb209b20 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-unplugged-fdc8f7a5-1b0e-4564-a0c7-106abb209b20 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-fdc8f7a5-1b0e-4564-a0c7-106abb209b20 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-fdc8f7a5-1b0e-4564-a0c7-106abb209b20 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:56 user nova-compute[71364]: WARNING nova.compute.manager [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-fdc8f7a5-1b0e-4564-a0c7-106abb209b20 for instance with vm_state active and task_state deleting.
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[802ea1db-6ebd-4a32-a4f5-362f38aca530]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66dc1fb-38f9-4808-84f1-54043a3cbc7e]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Flushing IO for device /dev/sdc {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a54a73b-f3c6-4dae-872c-cd8a6e471a63]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0baeaf-3244-430e-93b4-2b7c9509c711]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbf6969-325f-48ef-afa3-ce4fbfaa386d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c194c7a-6c6d-4b69-bcd3-e8fbc809aaca]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973, portal: 172.16.0.220,3260]
Apr 11 21:52:56 user nova-compute[71364]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:56 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88da00ff-62d9-4085-8048-3618f2fea973 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce0fd87-4cd4-46f0-880d-93f520b1d688]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] <== disconnect_volume: return (299ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPQybtlj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:52:56 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97e98ac-3674-4b30-9760-994b4370c382]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:52:56 user nova-compute[71364]: No targets found.
Apr 11 21:52:56 user nova-compute[71364]: iSNS:
Apr 11 21:52:56 user nova-compute[71364]: No targets found.
Apr 11 21:52:56 user nova-compute[71364]: STATIC:
Apr 11 21:52:56 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540
Apr 11 21:52:56 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:52:56 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:52:56 user nova-compute[71364]: FIRMWARE:
Apr 11 21:52:56 user nova-compute[71364]: No targets found.
Apr 11 21:52:56 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:52:56 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:52:56 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0aa4a6-4932-4e00-be7e-cecae1de10ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec20858c-fde6-4d29-9c8e-5ad6aad52295]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:56 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 (non-flash)
Apr 11 21:52:56 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bf44077f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540'): ({'sdd'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Removing single pathed devices sdd {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[63340abd-fdf9-4229-8b1b-98574caeb2e6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[283eb62e-fb6a-4c11-a26b-ad5151343b39]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Flushing IO for device /dev/sdd {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-7ff5ac2a-47b8-4a4e-9391-409086855c84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-7ff5ac2a-47b8-4a4e-9391-409086855c84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:56 user nova-compute[71364]: WARNING nova.compute.manager [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-7ff5ac2a-47b8-4a4e-9391-409086855c84 for instance with vm_state active and task_state deleting.
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-unplugged-2155540f-70ef-4d55-80dd-9f75bcd29afc {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-unplugged-2155540f-70ef-4d55-80dd-9f75bcd29afc {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-unplugged-2155540f-70ef-4d55-80dd-9f75bcd29afc for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-2155540f-70ef-4d55-80dd-9f75bcd29afc {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-2155540f-70ef-4d55-80dd-9f75bcd29afc {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:56 user nova-compute[71364]: WARNING nova.compute.manager [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-2155540f-70ef-4d55-80dd-9f75bcd29afc for instance with vm_state active and task_state deleting.
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f2396b-c588-489f-bcfe-174c24a3b444]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-bbec55d8-4603-42de-9cbf-aa3624101c27 req-3a96271a-c9ff-418b-b9a0-115d668ea1e3 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-plugged-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bbec55d8-4603-42de-9cbf-aa3624101c27 req-3a96271a-c9ff-418b-b9a0-115d668ea1e3 service nova] Acquiring lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bbec55d8-4603-42de-9cbf-aa3624101c27 req-3a96271a-c9ff-418b-b9a0-115d668ea1e3 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bbec55d8-4603-42de-9cbf-aa3624101c27 req-3a96271a-c9ff-418b-b9a0-115d668ea1e3 service nova] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-bbec55d8-4603-42de-9cbf-aa3624101c27 req-3a96271a-c9ff-418b-b9a0-115d668ea1e3 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] No waiting events found dispatching network-vif-plugged-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:52:56 user nova-compute[71364]: WARNING nova.compute.manager [req-bbec55d8-4603-42de-9cbf-aa3624101c27 req-3a96271a-c9ff-418b-b9a0-115d668ea1e3 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received unexpected event network-vif-plugged-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 for instance with vm_state active and task_state deleting.
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1182ee30-99ee-4dda-ad50-c969bbf5b83c]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.047s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd26b1e-d156-420a-859e-f9d9894c54c5]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdc8d9a-5429-4c1f-988a-2b9a6fdd8f86]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540, portal: 172.16.0.220,3260]
Apr 11 21:52:56 user nova-compute[71364]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540, portal: 172.16.0.220,3260] successful.
Apr 11 21:52:56 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba36538-41e5-4c4a-8b40-4e402df5d540 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a77b8d5-7a7f-4fe6-be7f-4dc9b93371f6]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] <== disconnect_volume: return (321ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:52:56 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Deleting instance files /opt/stack/data/nova/instances/b38bd805-2d70-441e-8853-73d4e092f4dc_del
Apr 11 21:52:56 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Deletion of /opt/stack/data/nova/instances/b38bd805-2d70-441e-8853-73d4e092f4dc_del complete
Apr 11 21:52:56 user nova-compute[71364]: INFO nova.compute.manager [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Took 3.06 seconds to destroy the instance on the hypervisor.
Apr 11 21:52:56 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:52:56 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:52:58 user nova-compute[71364]: DEBUG nova.compute.manager [req-597739ac-26ef-4505-8864-4dcf935b2ff5 req-19d893bc-dc31-407b-a517-684e4c57f80b service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-deleted-84178c3a-ce1d-40e5-a8df-b01039c2e595 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:52:58 user nova-compute[71364]: INFO nova.compute.manager [req-597739ac-26ef-4505-8864-4dcf935b2ff5 req-19d893bc-dc31-407b-a517-684e4c57f80b service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Neutron deleted interface 84178c3a-ce1d-40e5-a8df-b01039c2e595; detaching it from the instance and deleting it from the info cache
Apr 11 21:52:58 user nova-compute[71364]: DEBUG nova.network.neutron [req-597739ac-26ef-4505-8864-4dcf935b2ff5 req-19d893bc-dc31-407b-a517-684e4c57f80b service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updating instance_info_cache with network_info: [{"id": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "address": "fa:16:3e:08:e9:e5", "network": {"id": "fe19ecab-8008-4c75-b42c-893bf768d60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-366505631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bab3701-ca", "ovs_interfaceid": "4bab3701-cae5-4cde-a61d-d4a11308c5bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "053d127e-a3d3-40dd-92bb-c01cd0580309", "address": "fa:16:3e:fc:20:36", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.25", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053d127e-a3", "ovs_interfaceid": "053d127e-a3d3-40dd-92bb-c01cd0580309", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "address": "fa:16:3e:84:11:12", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ff5ac2a-47", "ovs_interfaceid": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "address": "fa:16:3e:11:2c:22", "network": {"id": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "bridge": "br-int", "label": "tempest-device-tagging-net1-2075884059", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb863f6b5-96", "ovs_interfaceid": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "address": "fa:16:3e:5d:35:f8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2155540f-70", "ovs_interfaceid": "2155540f-70ef-4d55-80dd-9f75bcd29afc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "address": "fa:16:3e:68:6d:d8", "network": {"id": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "bridge": "br-int", "label": "tempest-device-tagging-net2-1361373844", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0b6c690214fc4667b617cc760c352b30", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdc8f7a5-1b", "ovs_interfaceid": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:52:58 user nova-compute[71364]: DEBUG nova.compute.manager [req-597739ac-26ef-4505-8864-4dcf935b2ff5 req-19d893bc-dc31-407b-a517-684e4c57f80b service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Detach interface failed, port_id=84178c3a-ce1d-40e5-a8df-b01039c2e595, reason: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 21:52:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:52:59 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:52:59 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Took 3.27 seconds to deallocate network for instance.
Apr 11 21:53:00 user nova-compute[71364]: DEBUG nova.compute.manager [req-e807d6af-f59a-46b5-8ccf-3928d1c48e88 req-8b3e94ac-c67e-4b07-9d32-1e689dd5ab15 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-deleted-4bab3701-cae5-4cde-a61d-d4a11308c5bc {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:00 user nova-compute[71364]: DEBUG nova.compute.manager [req-e807d6af-f59a-46b5-8ccf-3928d1c48e88 req-8b3e94ac-c67e-4b07-9d32-1e689dd5ab15 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-deleted-2155540f-70ef-4d55-80dd-9f75bcd29afc {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:00 user nova-compute[71364]: DEBUG nova.compute.manager [req-e807d6af-f59a-46b5-8ccf-3928d1c48e88 req-8b3e94ac-c67e-4b07-9d32-1e689dd5ab15 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-deleted-fdc8f7a5-1b0e-4564-a0c7-106abb209b20 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:00 user nova-compute[71364]: DEBUG nova.compute.manager [req-e807d6af-f59a-46b5-8ccf-3928d1c48e88 req-8b3e94ac-c67e-4b07-9d32-1e689dd5ab15 service nova] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Received event network-vif-deleted-b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:02 user nova-compute[71364]: INFO nova.compute.manager [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Took 2.32 seconds to detach 3 volumes for instance.
Apr 11 21:53:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:02 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:53:02 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:53:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:02 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Deleted allocations for instance b38bd805-2d70-441e-8853-73d4e092f4dc
Apr 11 21:53:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "b38bd805-2d70-441e-8853-73d4e092f4dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.184s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:04 user nova-compute[71364]: DEBUG nova.compute.manager [req-11712179-8361-4e4a-999c-ea661c491db9 req-4cd73a71-7515-4e01-b3d7-b880d514b6a1 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Received event network-changed-a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:04 user nova-compute[71364]: DEBUG nova.compute.manager [req-11712179-8361-4e4a-999c-ea661c491db9 req-4cd73a71-7515-4e01-b3d7-b880d514b6a1 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Refreshing instance network info cache due to event network-changed-a85cff03-bd83-4fef-8abc-1615e5ceebd6. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:53:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-11712179-8361-4e4a-999c-ea661c491db9 req-4cd73a71-7515-4e01-b3d7-b880d514b6a1 service nova] Acquiring lock "refresh_cache-76315af2-c4b9-4ad5-98ea-81826524d63e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:53:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-11712179-8361-4e4a-999c-ea661c491db9 req-4cd73a71-7515-4e01-b3d7-b880d514b6a1 service nova] Acquired lock "refresh_cache-76315af2-c4b9-4ad5-98ea-81826524d63e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:53:04 user nova-compute[71364]: DEBUG nova.network.neutron [req-11712179-8361-4e4a-999c-ea661c491db9 req-4cd73a71-7515-4e01-b3d7-b880d514b6a1 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Refreshing network info cache for port a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:53:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "76315af2-c4b9-4ad5-98ea-81826524d63e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:04 user nova-compute[71364]: DEBUG nova.objects.instance [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lazy-loading 'flavor' on Instance uuid 76315af2-c4b9-4ad5-98ea-81826524d63e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "76315af2-c4b9-4ad5-98ea-81826524d63e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:05 user nova-compute[71364]: INFO nova.compute.manager [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Attaching volume 5a309571-4d40-4261-9d2a-801cea71456b to /dev/vdb
Apr 11 21:53:05 user nova-compute[71364]: DEBUG os_brick.utils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d2a5e0-1192-4714-840f-c4a0ed69df89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f1597a-502e-41c7-9046-9597cadd1d6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[76183d0e-c7cf-4e7e-ae95-f37ef02c466f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4604bb30-8ab5-4532-a59b-9213670255eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:53:05 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7671ce-843d-4fe0-a3e7-acf6807a3e8f]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG os_brick.utils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Updating existing volume attachment record: 1e623d58-8010-4064-b108-f678ccc56248 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG nova.network.neutron [req-11712179-8361-4e4a-999c-ea661c491db9 req-4cd73a71-7515-4e01-b3d7-b880d514b6a1 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Updated VIF entry in instance network info cache for port a85cff03-bd83-4fef-8abc-1615e5ceebd6. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG nova.network.neutron [req-11712179-8361-4e4a-999c-ea661c491db9 req-4cd73a71-7515-4e01-b3d7-b880d514b6a1 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Updating instance_info_cache with network_info: [{"id": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "address": "fa:16:3e:00:33:22", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85cff03-bd", "ovs_interfaceid": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-11712179-8361-4e4a-999c-ea661c491db9 req-4cd73a71-7515-4e01-b3d7-b880d514b6a1 service nova] Releasing lock "refresh_cache-76315af2-c4b9-4ad5-98ea-81826524d63e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:53:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCGvBJeF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:09 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:09 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:09 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[522a556f-ee59-4375-ac54-d910bdc698ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:53:09 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3cf9cb-b44f-430d-bd2d-224666ed57c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b] added
Apr 11 21:53:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acdd4a0-1c8a-4df1-bcee-ec88c1e93196]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ace3ca-70a7-41c6-83e6-c2cf0954e50d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZCGvBJeF {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZCGvBJeF" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[98366369-54ed-47f8-8f62-4b16ccf879a5]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZCGvBJeF'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[89126568-f1ca-4a1d-aaed-621c8d36f709]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d029395b-b0f6-4313-b5cd-5ef6121cd08d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:53:09 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:53:09 user nova-compute[71364]:  {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:09 user nova-compute[71364]: WARNING os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 21:53:09 user nova-compute[71364]: 
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f99dbf-05d8-48d1-98fb-d3effaa67dcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b, portal: 172.16.0.220,3260]
Apr 11 21:53:09 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b, portal: 172.16.0.220,3260] successful.
Apr 11 21:53:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5796c48-d010-48e0-9fef-e0a63662526b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ba2f46-19cc-4944-bb05-1bcd081dc733]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b (non-flash)
Apr 11 21:53:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b (non-flash)
Apr 11 21:53:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e29f93-23ec-48ee-87a2-f91e43c5abbf]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: None {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:53:10 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681249975.2691824, b38bd805-2d70-441e-8853-73d4e092f4dc => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:53:10 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] VM Stopped (Lifecycle Event)
Apr 11 21:53:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-4725a3f9-802a-4aa8-a398-4f47ca339ebe None None] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:53:10 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:53:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCGvBJeF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:53:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23734373434303133', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:53:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734373434303133', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:53:10 user nova-compute[71364]: DEBUG nova.objects.instance [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lazy-loading 'flavor' on Instance uuid 76315af2-c4b9-4ad5-98ea-81826524d63e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:53:10 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:53:10 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 21:53:10 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:53:10 user nova-compute[71364]:   <serial>5a309571-4d40-4261-9d2a-801cea71456b</serial>
Apr 11 21:53:10 user nova-compute[71364]: </disk>
Apr 11 21:53:10 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:53:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:53:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:53:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] No VIF found with MAC fa:16:3e:00:33:22, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:53:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.050s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "76315af2-c4b9-4ad5-98ea-81826524d63e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:12 user nova-compute[71364]: INFO nova.compute.manager [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Detaching volume 5a309571-4d40-4261-9d2a-801cea71456b
Apr 11 21:53:12 user nova-compute[71364]: INFO nova.virt.block_device [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Attempting to driver detach volume 5a309571-4d40-4261-9d2a-801cea71456b from mountpoint /dev/vdb
Apr 11 21:53:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Attempting to detach device vdb from instance 76315af2-c4b9-4ad5-98ea-81826524d63e from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:53:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:53:12 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:53:12 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 21:53:12 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:53:12 user nova-compute[71364]:   <serial>5a309571-4d40-4261-9d2a-801cea71456b</serial>
Apr 11 21:53:12 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:53:12 user nova-compute[71364]: </disk>
Apr 11 21:53:12 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:53:12 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Successfully detached device vdb from instance 76315af2-c4b9-4ad5-98ea-81826524d63e from the persistent domain config.
Apr 11 21:53:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 76315af2-c4b9-4ad5-98ea-81826524d63e from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:53:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:53:12 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:53:12 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 21:53:12 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:53:12 user nova-compute[71364]:   <serial>5a309571-4d40-4261-9d2a-801cea71456b</serial>
Apr 11 21:53:12 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:53:12 user nova-compute[71364]: </disk>
Apr 11 21:53:12 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681249993.2793038, 76315af2-c4b9-4ad5-98ea-81826524d63e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 76315af2-c4b9-4ad5-98ea-81826524d63e {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:53:13 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Successfully detached device vdb from instance 76315af2-c4b9-4ad5-98ea-81826524d63e from the live domain config.
Apr 11 21:53:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZCGvBJeF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:13 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[94999724-cb4f-4859-8399-15bf52cde63b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:53:13 user nova-compute[71364]: No targets found.
Apr 11 21:53:13 user nova-compute[71364]: iSNS:
Apr 11 21:53:13 user nova-compute[71364]: No targets found.
Apr 11 21:53:13 user nova-compute[71364]: STATIC:
Apr 11 21:53:13 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b
Apr 11 21:53:13 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:53:13 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:53:13 user nova-compute[71364]: FIRMWARE:
Apr 11 21:53:13 user nova-compute[71364]: No targets found.
Apr 11 21:53:13 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:53:13 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:53:13 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[241bf15a-b754-4db7-a1b2-3036aff4ed86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3404485-d3a8-421c-aa0f-248f0121437e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b (non-flash)
Apr 11 21:53:13 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b (non-flash)
Apr 11 21:53:13 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff7a2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e9c3ac-c088-4ab4-a4fe-8ec7953d5800]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78abd9c-7481-48c6-a5d2-b21b9219e420]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d65ea7b-3f80-48cb-933d-0e1d712373c0]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aeb51a-3afd-42d1-85c5-b37e3c5157f2]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b4f2c4-5e85-4c0b-982c-8e89a238767e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[de84ddc2-0f0b-44fb-924f-eaf2beab5725]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b, portal: 172.16.0.220,3260]
Apr 11 21:53:13 user nova-compute[71364]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b, portal: 172.16.0.220,3260] successful.
Apr 11 21:53:13 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a309571-4d40-4261-9d2a-801cea71456b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff377d7-c8ab-4aac-a896-1593e0223be6]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] <== disconnect_volume: return (266ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:53:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:14 user nova-compute[71364]: DEBUG nova.objects.instance [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lazy-loading 'flavor' on Instance uuid 76315af2-c4b9-4ad5-98ea-81826524d63e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.662s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:53:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:53:19 user nova-compute[71364]: INFO nova.compute.claims [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Claim successful on node user
Apr 11 21:53:19 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:53:19 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:53:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:53:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:53:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:53:19 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:53:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG nova.policy [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37879b83a5b74e28bcde8d4885fa4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457b454a52ca4559b8398291e482ba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:53:20 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Creating image(s)
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "/opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "/opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk 1073741824" returned: 0 in 0.049s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.166s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG nova.network.neutron [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Successfully created port: 9e008c4e-6a6e-40b5-b6ad-74832e90044b {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Cannot resize image /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG nova.objects.instance [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lazy-loading 'migration_context' on Instance uuid f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Ensure instance console log exists: /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:21 user nova-compute[71364]: DEBUG nova.network.neutron [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Successfully updated port: 9e008c4e-6a6e-40b5-b6ad-74832e90044b {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:53:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "refresh_cache-f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:53:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquired lock "refresh_cache-f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:53:21 user nova-compute[71364]: DEBUG nova.network.neutron [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:53:21 user nova-compute[71364]: DEBUG nova.compute.manager [req-8a50f46b-6f27-495e-ab5c-ba60d685c0cd req-eb023a25-f0b1-438c-b5f3-a0695c7c1593 service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Received event network-changed-9e008c4e-6a6e-40b5-b6ad-74832e90044b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:21 user nova-compute[71364]: DEBUG nova.compute.manager [req-8a50f46b-6f27-495e-ab5c-ba60d685c0cd req-eb023a25-f0b1-438c-b5f3-a0695c7c1593 service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Refreshing instance network info cache due to event network-changed-9e008c4e-6a6e-40b5-b6ad-74832e90044b. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:53:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8a50f46b-6f27-495e-ab5c-ba60d685c0cd req-eb023a25-f0b1-438c-b5f3-a0695c7c1593 service nova] Acquiring lock "refresh_cache-f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:53:21 user nova-compute[71364]: DEBUG nova.network.neutron [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.network.neutron [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Updating instance_info_cache with network_info: [{"id": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "address": "fa:16:3e:cc:73:21", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008c4e-6a", "ovs_interfaceid": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Releasing lock "refresh_cache-f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Instance network_info: |[{"id": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "address": "fa:16:3e:cc:73:21", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008c4e-6a", "ovs_interfaceid": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8a50f46b-6f27-495e-ab5c-ba60d685c0cd req-eb023a25-f0b1-438c-b5f3-a0695c7c1593 service nova] Acquired lock "refresh_cache-f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.network.neutron [req-8a50f46b-6f27-495e-ab5c-ba60d685c0cd req-eb023a25-f0b1-438c-b5f3-a0695c7c1593 service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Refreshing network info cache for port 9e008c4e-6a6e-40b5-b6ad-74832e90044b {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Start _get_guest_xml network_info=[{"id": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "address": "fa:16:3e:cc:73:21", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008c4e-6a", "ovs_interfaceid": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:53:22 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:53:22 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-179279204',display_name='tempest-VolumesAdminNegativeTest-server-179279204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-179279204',id=12,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457b454a52ca4559b8398291e482ba70',ramdisk_id='',reservation_id='r-m5fvjwfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1674781287',owner_user_name='tempest-VolumesAdminNegativeTest-1674781287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:20Z,user_data=None,user_id='37879b83a5b74e28bcde8d4885fa4ccc',uuid=f9121cd6-27a4-4c09-8eb9-3f4bb48cb934,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "address": "fa:16:3e:cc:73:21", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008c4e-6a", "ovs_interfaceid": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Converting VIF {"id": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "address": "fa:16:3e:cc:73:21", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008c4e-6a", "ovs_interfaceid": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:73:21,bridge_name='br-int',has_traffic_filtering=True,id=9e008c4e-6a6e-40b5-b6ad-74832e90044b,network=Network(61f0f827-13c4-4f31-9a58-c653a4b3a778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e008c4e-6a') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.objects.instance [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lazy-loading 'pci_devices' on Instance uuid f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:53:22 user nova-compute[71364]:   <uuid>f9121cd6-27a4-4c09-8eb9-3f4bb48cb934</uuid>
Apr 11 21:53:22 user nova-compute[71364]:   <name>instance-0000000c</name>
Apr 11 21:53:22 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:53:22 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:53:22 user nova-compute[71364]:   <metadata>
Apr 11 21:53:22 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:53:22 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:53:22 user nova-compute[71364]:       <nova:name>tempest-VolumesAdminNegativeTest-server-179279204</nova:name>
Apr 11 21:53:22 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:53:22</nova:creationTime>
Apr 11 21:53:22 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:53:22 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:53:22 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:53:22 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:53:22 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:53:22 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:53:22 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:53:22 user nova-compute[71364]:       <nova:owner>
Apr 11 21:53:22 user nova-compute[71364]:         <nova:user uuid="37879b83a5b74e28bcde8d4885fa4ccc">tempest-VolumesAdminNegativeTest-1674781287-project-member</nova:user>
Apr 11 21:53:22 user nova-compute[71364]:         <nova:project uuid="457b454a52ca4559b8398291e482ba70">tempest-VolumesAdminNegativeTest-1674781287</nova:project>
Apr 11 21:53:22 user nova-compute[71364]:       </nova:owner>
Apr 11 21:53:22 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:53:22 user nova-compute[71364]:       <nova:ports>
Apr 11 21:53:22 user nova-compute[71364]:         <nova:port uuid="9e008c4e-6a6e-40b5-b6ad-74832e90044b">
Apr 11 21:53:22 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 21:53:22 user nova-compute[71364]:         </nova:port>
Apr 11 21:53:22 user nova-compute[71364]:       </nova:ports>
Apr 11 21:53:22 user nova-compute[71364]:     </nova:instance>
Apr 11 21:53:22 user nova-compute[71364]:   </metadata>
Apr 11 21:53:22 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:53:22 user nova-compute[71364]:     <system>
Apr 11 21:53:22 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:53:22 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:53:22 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:53:22 user nova-compute[71364]:       <entry name="serial">f9121cd6-27a4-4c09-8eb9-3f4bb48cb934</entry>
Apr 11 21:53:22 user nova-compute[71364]:       <entry name="uuid">f9121cd6-27a4-4c09-8eb9-3f4bb48cb934</entry>
Apr 11 21:53:22 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:53:22 user nova-compute[71364]:     </system>
Apr 11 21:53:22 user nova-compute[71364]:   </sysinfo>
Apr 11 21:53:22 user nova-compute[71364]:   <os>
Apr 11 21:53:22 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:53:22 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:53:22 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:53:22 user nova-compute[71364]:   </os>
Apr 11 21:53:22 user nova-compute[71364]:   <features>
Apr 11 21:53:22 user nova-compute[71364]:     <acpi/>
Apr 11 21:53:22 user nova-compute[71364]:     <apic/>
Apr 11 21:53:22 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:53:22 user nova-compute[71364]:   </features>
Apr 11 21:53:22 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:53:22 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:53:22 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:53:22 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:53:22 user nova-compute[71364]:   </clock>
Apr 11 21:53:22 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:53:22 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:53:22 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:53:22 user nova-compute[71364]:   </cpu>
Apr 11 21:53:22 user nova-compute[71364]:   <devices>
Apr 11 21:53:22 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:53:22 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:53:22 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk"/>
Apr 11 21:53:22 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:53:22 user nova-compute[71364]:     </disk>
Apr 11 21:53:22 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:53:22 user nova-compute[71364]:       <mac address="fa:16:3e:cc:73:21"/>
Apr 11 21:53:22 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:53:22 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:53:22 user nova-compute[71364]:       <target dev="tap9e008c4e-6a"/>
Apr 11 21:53:22 user nova-compute[71364]:     </interface>
Apr 11 21:53:22 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:53:22 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/console.log" append="off"/>
Apr 11 21:53:22 user nova-compute[71364]:     </serial>
Apr 11 21:53:22 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:53:22 user nova-compute[71364]:     <video>
Apr 11 21:53:22 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:53:22 user nova-compute[71364]:     </video>
Apr 11 21:53:22 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:53:22 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:53:22 user nova-compute[71364]:     </rng>
Apr 11 21:53:22 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:53:22 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:53:22 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:53:22 user nova-compute[71364]:     </memballoon>
Apr 11 21:53:22 user nova-compute[71364]:   </devices>
Apr 11 21:53:22 user nova-compute[71364]: </domain>
Apr 11 21:53:22 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-179279204',display_name='tempest-VolumesAdminNegativeTest-server-179279204',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-179279204',id=12,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457b454a52ca4559b8398291e482ba70',ramdisk_id='',reservation_id='r-m5fvjwfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1674781287',owner_user_name='tempest-VolumesAdminNegativeTest-1674781287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:20Z,user_data=None,user_id='37879b83a5b74e28bcde8d4885fa4ccc',uuid=f9121cd6-27a4-4c09-8eb9-3f4bb48cb934,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "address": "fa:16:3e:cc:73:21", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008c4e-6a", "ovs_interfaceid": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Converting VIF {"id": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "address": "fa:16:3e:cc:73:21", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008c4e-6a", "ovs_interfaceid": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:73:21,bridge_name='br-int',has_traffic_filtering=True,id=9e008c4e-6a6e-40b5-b6ad-74832e90044b,network=Network(61f0f827-13c4-4f31-9a58-c653a4b3a778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e008c4e-6a') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG os_vif [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:73:21,bridge_name='br-int',has_traffic_filtering=True,id=9e008c4e-6a6e-40b5-b6ad-74832e90044b,network=Network(61f0f827-13c4-4f31-9a58-c653a4b3a778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e008c4e-6a') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e008c4e-6a, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e008c4e-6a, col_values=(('external_ids', {'iface-id': '9e008c4e-6a6e-40b5-b6ad-74832e90044b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:73:21', 'vm-uuid': 'f9121cd6-27a4-4c09-8eb9-3f4bb48cb934'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:22 user nova-compute[71364]: INFO os_vif [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:73:21,bridge_name='br-int',has_traffic_filtering=True,id=9e008c4e-6a6e-40b5-b6ad-74832e90044b,network=Network(61f0f827-13c4-4f31-9a58-c653a4b3a778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e008c4e-6a')
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] No VIF found with MAC fa:16:3e:cc:73:21, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "335d5305-28e6-4766-b0b2-b56848ff8652" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "335d5305-28e6-4766-b0b2-b56848ff8652" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:22 user nova-compute[71364]: INFO nova.compute.manager [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Terminating instance
Apr 11 21:53:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG nova.network.neutron [req-8a50f46b-6f27-495e-ab5c-ba60d685c0cd req-eb023a25-f0b1-438c-b5f3-a0695c7c1593 service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Updated VIF entry in instance network info cache for port 9e008c4e-6a6e-40b5-b6ad-74832e90044b. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG nova.network.neutron [req-8a50f46b-6f27-495e-ab5c-ba60d685c0cd req-eb023a25-f0b1-438c-b5f3-a0695c7c1593 service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Updating instance_info_cache with network_info: [{"id": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "address": "fa:16:3e:cc:73:21", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008c4e-6a", "ovs_interfaceid": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8a50f46b-6f27-495e-ab5c-ba60d685c0cd req-eb023a25-f0b1-438c-b5f3-a0695c7c1593 service nova] Releasing lock "refresh_cache-f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-bb81bf3f-606e-4d30-939f-1ea525fbd531 req-73f3475e-58e4-4d18-9d9b-bf81c72d224e service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received event network-vif-unplugged-875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bb81bf3f-606e-4d30-939f-1ea525fbd531 req-73f3475e-58e4-4d18-9d9b-bf81c72d224e service nova] Acquiring lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bb81bf3f-606e-4d30-939f-1ea525fbd531 req-73f3475e-58e4-4d18-9d9b-bf81c72d224e service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bb81bf3f-606e-4d30-939f-1ea525fbd531 req-73f3475e-58e4-4d18-9d9b-bf81c72d224e service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-bb81bf3f-606e-4d30-939f-1ea525fbd531 req-73f3475e-58e4-4d18-9d9b-bf81c72d224e service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] No waiting events found dispatching network-vif-unplugged-875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-bb81bf3f-606e-4d30-939f-1ea525fbd531 req-73f3475e-58e4-4d18-9d9b-bf81c72d224e service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received event network-vif-unplugged-875f44f1-120e-48bc-9742-662c6bb93332 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:53:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:24 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Instance destroyed successfully.
Apr 11 21:53:24 user nova-compute[71364]: DEBUG nova.objects.instance [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lazy-loading 'resources' on Instance uuid 335d5305-28e6-4766-b0b2-b56848ff8652 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:50:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-221002458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-221002458',id=6,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9SP67fRzYDr8pH3V24PAo6C5dZmRotW5QhNbjR+STaXowwhPQJNMYnIBrtgPE8JNDkIhvyxuwrwGRJsSpYFrzFZJJ9OejIdMCTzPDQ0PbvVC018NQN2jkSZDBN+Zyluw==',key_name='tempest-keypair-156975459',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2ba7063a25043fdb16f3e1f0c0c51d3',ramdisk_id='',reservation_id='r-0l47ba19',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2065530295',owner_user_name='tempest-TaggedAttachmentsTest-2065530295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08dd18a54a074e658d08ca381e0c87ff',uuid=335d5305-28e6-4766-b0b2-b56848ff8652,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "875f44f1-120e-48bc-9742-662c6bb93332", "address": "fa:16:3e:27:80:f5", "network": {"id": "35eb0a23-469f-4f8a-8c16-1cea8207fd79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1614521033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875f44f1-12", "ovs_interfaceid": "875f44f1-120e-48bc-9742-662c6bb93332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Converting VIF {"id": "875f44f1-120e-48bc-9742-662c6bb93332", "address": "fa:16:3e:27:80:f5", "network": {"id": "35eb0a23-469f-4f8a-8c16-1cea8207fd79", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1614521033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2ba7063a25043fdb16f3e1f0c0c51d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap875f44f1-12", "ovs_interfaceid": "875f44f1-120e-48bc-9742-662c6bb93332", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:80:f5,bridge_name='br-int',has_traffic_filtering=True,id=875f44f1-120e-48bc-9742-662c6bb93332,network=Network(35eb0a23-469f-4f8a-8c16-1cea8207fd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875f44f1-12') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG os_vif [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:80:f5,bridge_name='br-int',has_traffic_filtering=True,id=875f44f1-120e-48bc-9742-662c6bb93332,network=Network(35eb0a23-469f-4f8a-8c16-1cea8207fd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875f44f1-12') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap875f44f1-12, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:24 user nova-compute[71364]: INFO os_vif [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:80:f5,bridge_name='br-int',has_traffic_filtering=True,id=875f44f1-120e-48bc-9742-662c6bb93332,network=Network(35eb0a23-469f-4f8a-8c16-1cea8207fd79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap875f44f1-12')
Apr 11 21:53:24 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Deleting instance files /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652_del
Apr 11 21:53:24 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Deletion of /opt/stack/data/nova/instances/335d5305-28e6-4766-b0b2-b56848ff8652_del complete
Apr 11 21:53:24 user nova-compute[71364]: INFO nova.compute.manager [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Took 1.57 seconds to destroy the instance on the hypervisor.
Apr 11 21:53:24 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-c66edb9a-563c-49c2-996b-83c03a078ec5 req-2db89431-c9ba-4731-aa83-6ff38ca99a01 service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Received event network-vif-plugged-9e008c4e-6a6e-40b5-b6ad-74832e90044b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c66edb9a-563c-49c2-996b-83c03a078ec5 req-2db89431-c9ba-4731-aa83-6ff38ca99a01 service nova] Acquiring lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c66edb9a-563c-49c2-996b-83c03a078ec5 req-2db89431-c9ba-4731-aa83-6ff38ca99a01 service nova] Lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c66edb9a-563c-49c2-996b-83c03a078ec5 req-2db89431-c9ba-4731-aa83-6ff38ca99a01 service nova] Lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-c66edb9a-563c-49c2-996b-83c03a078ec5 req-2db89431-c9ba-4731-aa83-6ff38ca99a01 service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] No waiting events found dispatching network-vif-plugged-9e008c4e-6a6e-40b5-b6ad-74832e90044b {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:24 user nova-compute[71364]: WARNING nova.compute.manager [req-c66edb9a-563c-49c2-996b-83c03a078ec5 req-2db89431-c9ba-4731-aa83-6ff38ca99a01 service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Received unexpected event network-vif-plugged-9e008c4e-6a6e-40b5-b6ad-74832e90044b for instance with vm_state building and task_state spawning.
Apr 11 21:53:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-847212f9-2d07-45df-9f8b-9f77da2afaba req-cee00501-5736-46dc-9750-32b6ecdabbb4 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received event network-vif-plugged-875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-847212f9-2d07-45df-9f8b-9f77da2afaba req-cee00501-5736-46dc-9750-32b6ecdabbb4 service nova] Acquiring lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-847212f9-2d07-45df-9f8b-9f77da2afaba req-cee00501-5736-46dc-9750-32b6ecdabbb4 service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-847212f9-2d07-45df-9f8b-9f77da2afaba req-cee00501-5736-46dc-9750-32b6ecdabbb4 service nova] Lock "335d5305-28e6-4766-b0b2-b56848ff8652-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-847212f9-2d07-45df-9f8b-9f77da2afaba req-cee00501-5736-46dc-9750-32b6ecdabbb4 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] No waiting events found dispatching network-vif-plugged-875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:25 user nova-compute[71364]: WARNING nova.compute.manager [req-847212f9-2d07-45df-9f8b-9f77da2afaba req-cee00501-5736-46dc-9750-32b6ecdabbb4 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received unexpected event network-vif-plugged-875f44f1-120e-48bc-9742-662c6bb93332 for instance with vm_state active and task_state deleting.
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:26 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Took 1.70 seconds to deallocate network for instance.
Apr 11 21:53:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:26 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Deleted allocations for instance 335d5305-28e6-4766-b0b2-b56848ff8652
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250006.6937335, f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:53:26 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] VM Resumed (Lifecycle Event)
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:53:26 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Instance spawned successfully.
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:53:26 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250006.6949694, f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:53:26 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] VM Started (Lifecycle Event)
Apr 11 21:53:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "335d5305-28e6-4766-b0b2-b56848ff8652" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.818s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:53:26 user nova-compute[71364]: INFO nova.compute.manager [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Took 6.76 seconds to spawn the instance on the hypervisor.
Apr 11 21:53:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:53:26 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:53:26 user nova-compute[71364]: INFO nova.compute.manager [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Took 7.44 seconds to build instance.
Apr 11 21:53:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.529s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-d906f53c-f2de-4e7f-b98a-1315792cad99 req-f1a20e3b-ab4f-4c3e-9ec2-abc31118d394 service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Received event network-vif-plugged-9e008c4e-6a6e-40b5-b6ad-74832e90044b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d906f53c-f2de-4e7f-b98a-1315792cad99 req-f1a20e3b-ab4f-4c3e-9ec2-abc31118d394 service nova] Acquiring lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d906f53c-f2de-4e7f-b98a-1315792cad99 req-f1a20e3b-ab4f-4c3e-9ec2-abc31118d394 service nova] Lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d906f53c-f2de-4e7f-b98a-1315792cad99 req-f1a20e3b-ab4f-4c3e-9ec2-abc31118d394 service nova] Lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-d906f53c-f2de-4e7f-b98a-1315792cad99 req-f1a20e3b-ab4f-4c3e-9ec2-abc31118d394 service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] No waiting events found dispatching network-vif-plugged-9e008c4e-6a6e-40b5-b6ad-74832e90044b {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:27 user nova-compute[71364]: WARNING nova.compute.manager [req-d906f53c-f2de-4e7f-b98a-1315792cad99 req-f1a20e3b-ab4f-4c3e-9ec2-abc31118d394 service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Received unexpected event network-vif-plugged-9e008c4e-6a6e-40b5-b6ad-74832e90044b for instance with vm_state active and task_state None.
Apr 11 21:53:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-d906f53c-f2de-4e7f-b98a-1315792cad99 req-f1a20e3b-ab4f-4c3e-9ec2-abc31118d394 service nova] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Received event network-vif-deleted-875f44f1-120e-48bc-9742-662c6bb93332 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:53:28 user nova-compute[71364]: INFO nova.compute.claims [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Claim successful on node user
Apr 11 21:53:28 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:53:28 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:53:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:53:28 user nova-compute[71364]: INFO nova.virt.block_device [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Booting with volume 83a59923-4f76-4871-86e2-bf7037b54cf9 at /dev/vda
Apr 11 21:53:28 user nova-compute[71364]: DEBUG os_brick.utils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f0dc63-8291-4cf0-aceb-6cb7997d29f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG nova.policy [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd79d201860f9413e91c6e5b80e82e7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b0f77f6e26488bb231a4148a769aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[941b9261-3860-4b6a-8df6-85fdd941127b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dad0ec6-eef9-4710-8425-2f6736fa4a5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb97fb5e-53a5-4db6-b44d-6bc4bb20e20b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:53:28 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:53:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e8188-9ad8-4edd-9314-84c8f1969964]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG os_brick.utils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:53:28 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updating existing volume attachment record: 50efb3dc-1016-4168-909e-ca3528f18be5 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:53:29 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Successfully created port: 9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:53:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:30 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Successfully created port: 625dda14-0cd1-4178-b941-7e6a6a789011 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:53:30 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Successfully created port: dfa4c745-6e10-4e48-af69-924a0beade68 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:53:31 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Successfully created port: 2465799c-3bee-44e6-bb98-a4db89e860a6 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:53:32 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Successfully created port: 3d194ea3-fda7-4516-8ace-0029b125ef0f {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:53:32 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Successfully updated port: 9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:53:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-a08cff4e-4f64-4516-b1f1-5fe0cd83c7d1 req-b0efd16c-27b3-4f2d-8eec-f18b6d38f34a service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-changed-9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-a08cff4e-4f64-4516-b1f1-5fe0cd83c7d1 req-b0efd16c-27b3-4f2d-8eec-f18b6d38f34a service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing instance network info cache due to event network-changed-9b81aa7e-ae9c-4e29-90c1-5060b7520348. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:53:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a08cff4e-4f64-4516-b1f1-5fe0cd83c7d1 req-b0efd16c-27b3-4f2d-8eec-f18b6d38f34a service nova] Acquiring lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:53:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a08cff4e-4f64-4516-b1f1-5fe0cd83c7d1 req-b0efd16c-27b3-4f2d-8eec-f18b6d38f34a service nova] Acquired lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:53:32 user nova-compute[71364]: DEBUG nova.network.neutron [req-a08cff4e-4f64-4516-b1f1-5fe0cd83c7d1 req-b0efd16c-27b3-4f2d-8eec-f18b6d38f34a service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing network info cache for port 9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG nova.network.neutron [req-a08cff4e-4f64-4516-b1f1-5fe0cd83c7d1 req-b0efd16c-27b3-4f2d-8eec-f18b6d38f34a service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG nova.network.neutron [req-a08cff4e-4f64-4516-b1f1-5fe0cd83c7d1 req-b0efd16c-27b3-4f2d-8eec-f18b6d38f34a service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a08cff4e-4f64-4516-b1f1-5fe0cd83c7d1 req-b0efd16c-27b3-4f2d-8eec-f18b6d38f34a service nova] Releasing lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:53:33 user nova-compute[71364]: INFO nova.virt.block_device [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Booting with volume f3890453-b356-4763-9d7c-ec5cca79e4ed at /dev/vdb
Apr 11 21:53:33 user nova-compute[71364]: DEBUG os_brick.utils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5174ea-c00b-4333-9c0d-479480899ad7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6dc3f1-7fa2-4788-8bea-20c58e9c6df2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec1813c-9b79-44fb-9c60-59197cf79920]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3251f7-ec30-45e3-84e7-29c6249107f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:53:33 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:53:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c222dbd-b942-41a3-98ea-bdf12407f3f3]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG os_brick.utils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updating existing volume attachment record: fa783d30-9df8-472a-bea2-bf7b8fed1b6a {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:53:33 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Successfully updated port: be49154e-53c0-44f6-b010-8eba5fb9e0ce {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:53:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:35 user nova-compute[71364]: DEBUG nova.compute.manager [req-506b889c-f993-4ac5-9f8e-885a46332a57 req-86a49818-0b15-49d4-b7f0-c0e8cf45d043 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-changed-be49154e-53c0-44f6-b010-8eba5fb9e0ce {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:35 user nova-compute[71364]: DEBUG nova.compute.manager [req-506b889c-f993-4ac5-9f8e-885a46332a57 req-86a49818-0b15-49d4-b7f0-c0e8cf45d043 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing instance network info cache due to event network-changed-be49154e-53c0-44f6-b010-8eba5fb9e0ce. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:53:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-506b889c-f993-4ac5-9f8e-885a46332a57 req-86a49818-0b15-49d4-b7f0-c0e8cf45d043 service nova] Acquiring lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:53:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-506b889c-f993-4ac5-9f8e-885a46332a57 req-86a49818-0b15-49d4-b7f0-c0e8cf45d043 service nova] Acquired lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:53:35 user nova-compute[71364]: DEBUG nova.network.neutron [req-506b889c-f993-4ac5-9f8e-885a46332a57 req-86a49818-0b15-49d4-b7f0-c0e8cf45d043 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing network info cache for port be49154e-53c0-44f6-b010-8eba5fb9e0ce {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:53:35 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Successfully updated port: 953ab328-2cc0-42c1-ab3c-4a0062140f8f {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:53:35 user nova-compute[71364]: DEBUG nova.network.neutron [req-506b889c-f993-4ac5-9f8e-885a46332a57 req-86a49818-0b15-49d4-b7f0-c0e8cf45d043 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:53:35 user nova-compute[71364]: DEBUG nova.network.neutron [req-506b889c-f993-4ac5-9f8e-885a46332a57 req-86a49818-0b15-49d4-b7f0-c0e8cf45d043 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-506b889c-f993-4ac5-9f8e-885a46332a57 req-86a49818-0b15-49d4-b7f0-c0e8cf45d043 service nova] Releasing lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:53:35 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Successfully updated port: 625dda14-0cd1-4178-b941-7e6a6a789011 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:53:36 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Successfully updated port: dfa4c745-6e10-4e48-af69-924a0beade68 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-changed-953ab328-2cc0-42c1-ab3c-4a0062140f8f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing instance network info cache due to event network-changed-953ab328-2cc0-42c1-ab3c-4a0062140f8f. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Acquiring lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Acquired lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.network.neutron [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing network info cache for port 953ab328-2cc0-42c1-ab3c-4a0062140f8f {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.network.neutron [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Successfully updated port: 2465799c-3bee-44e6-bb98-a4db89e860a6 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.network.neutron [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Releasing lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-changed-625dda14-0cd1-4178-b941-7e6a6a789011 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing instance network info cache due to event network-changed-625dda14-0cd1-4178-b941-7e6a6a789011. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Acquiring lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Acquired lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.network.neutron [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing network info cache for port 625dda14-0cd1-4178-b941-7e6a6a789011 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.network.neutron [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.network.neutron [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Releasing lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-changed-dfa4c745-6e10-4e48-af69-924a0beade68 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing instance network info cache due to event network-changed-dfa4c745-6e10-4e48-af69-924a0beade68. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Acquiring lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Acquired lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.network.neutron [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing network info cache for port dfa4c745-6e10-4e48-af69-924a0beade68 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:53:37 user nova-compute[71364]: DEBUG nova.network.neutron [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG nova.network.neutron [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Releasing lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Successfully updated port: 3d194ea3-fda7-4516-8ace-0029b125ef0f {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquired lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "d9341aca-d5c9-4c23-b8de-adb5360721bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "d9341aca-d5c9-4c23-b8de-adb5360721bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:38 user nova-compute[71364]: INFO nova.compute.manager [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Terminating instance
Apr 11 21:53:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:53:38 user nova-compute[71364]: INFO nova.virt.block_device [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Booting with volume 1ac97080-f468-4233-9080-da800780218d at /dev/vdc
Apr 11 21:53:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG os_brick.utils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac91054-f973-402f-ae4f-46ff4bd440ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c61360-a323-4576-955a-6c7084b29739]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c374ba4b-41fd-409b-aa31-b890e79fd991]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[059ee532-9782-43f9-b7dd-1846ac3f8452]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:53:38 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:53:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b138cdb8-f7e4-4aad-aea4-ea5b809e0b9f]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG os_brick.utils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updating existing volume attachment record: 927e014b-a82b-46f0-93dc-49186cef2173 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:38 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Instance destroyed successfully.
Apr 11 21:53:38 user nova-compute[71364]: DEBUG nova.objects.instance [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lazy-loading 'resources' on Instance uuid d9341aca-d5c9-4c23-b8de-adb5360721bf {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-640184675',display_name='tempest-ServersNegativeTestJSON-server-640184675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-640184675',id=11,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:51:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db880c2bdad74479a85e926c37352962',ramdisk_id='',reservation_id='r-5p0bfdmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-46827538',owner_user_name='tempest-ServersNegativeTestJSON-46827538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:51:55Z,user_data=None,user_id='839497b8586f4d9c8cc849e1de31c0e9',uuid=d9341aca-d5c9-4c23-b8de-adb5360721bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22ba4180-8733-488d-93d4-71b404970953", "address": "fa:16:3e:ac:f9:06", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ba4180-87", "ovs_interfaceid": "22ba4180-8733-488d-93d4-71b404970953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Converting VIF {"id": "22ba4180-8733-488d-93d4-71b404970953", "address": "fa:16:3e:ac:f9:06", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ba4180-87", "ovs_interfaceid": "22ba4180-8733-488d-93d4-71b404970953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:f9:06,bridge_name='br-int',has_traffic_filtering=True,id=22ba4180-8733-488d-93d4-71b404970953,network=Network(e7c6d356-dca6-4d85-ac96-dc14b5e5993d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ba4180-87') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG os_vif [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:f9:06,bridge_name='br-int',has_traffic_filtering=True,id=22ba4180-8733-488d-93d4-71b404970953,network=Network(e7c6d356-dca6-4d85-ac96-dc14b5e5993d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ba4180-87') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22ba4180-87, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:53:39 user nova-compute[71364]: INFO os_vif [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:f9:06,bridge_name='br-int',has_traffic_filtering=True,id=22ba4180-8733-488d-93d4-71b404970953,network=Network(e7c6d356-dca6-4d85-ac96-dc14b5e5993d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22ba4180-87')
Apr 11 21:53:39 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Deleting instance files /opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf_del
Apr 11 21:53:39 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Deletion of /opt/stack/data/nova/instances/d9341aca-d5c9-4c23-b8de-adb5360721bf_del complete
Apr 11 21:53:39 user nova-compute[71364]: INFO nova.compute.manager [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Took 0.78 seconds to destroy the instance on the hypervisor.
Apr 11 21:53:39 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:53:39 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:53:39 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:53:39 user nova-compute[71364]: DEBUG nova.compute.manager [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-changed-2465799c-3bee-44e6-bb98-a4db89e860a6 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:39 user nova-compute[71364]: DEBUG nova.compute.manager [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing instance network info cache due to event network-changed-2465799c-3bee-44e6-bb98-a4db89e860a6. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:53:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Acquiring lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:53:39 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250004.398322, 335d5305-28e6-4766-b0b2-b56848ff8652 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:53:39 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] VM Stopped (Lifecycle Event)
Apr 11 21:53:39 user nova-compute[71364]: DEBUG nova.compute.manager [None req-39bf94e4-8341-43f2-b432-b2e1524dddcc None None] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:53:39 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:39 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Took 0.51 seconds to deallocate network for instance.
Apr 11 21:53:39 user nova-compute[71364]: DEBUG nova.compute.manager [req-4347c545-371e-4326-857b-05e36c5e19d5 req-37a068da-bd21-4b42-9ef3-7aeca851dc10 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Received event network-vif-deleted-22ba4180-8733-488d-93d4-71b404970953 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:39 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:53:39 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:53:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:40 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Deleted allocations for instance d9341aca-d5c9-4c23-b8de-adb5360721bf
Apr 11 21:53:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "d9341aca-d5c9-4c23-b8de-adb5360721bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.871s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-bdf9d079-91b8-42d2-a913-481b3cee148a req-2514c592-f013-4d31-924e-bd7a8cb03d9d service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Received event network-vif-plugged-22ba4180-8733-488d-93d4-71b404970953 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bdf9d079-91b8-42d2-a913-481b3cee148a req-2514c592-f013-4d31-924e-bd7a8cb03d9d service nova] Acquiring lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bdf9d079-91b8-42d2-a913-481b3cee148a req-2514c592-f013-4d31-924e-bd7a8cb03d9d service nova] Lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bdf9d079-91b8-42d2-a913-481b3cee148a req-2514c592-f013-4d31-924e-bd7a8cb03d9d service nova] Lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-bdf9d079-91b8-42d2-a913-481b3cee148a req-2514c592-f013-4d31-924e-bd7a8cb03d9d service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] No waiting events found dispatching network-vif-plugged-22ba4180-8733-488d-93d4-71b404970953 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:41 user nova-compute[71364]: WARNING nova.compute.manager [req-bdf9d079-91b8-42d2-a913-481b3cee148a req-2514c592-f013-4d31-924e-bd7a8cb03d9d service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Received unexpected event network-vif-plugged-22ba4180-8733-488d-93d4-71b404970953 for instance with vm_state deleted and task_state None.
Apr 11 21:53:41 user nova-compute[71364]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updating instance_info_cache with network_info: [{"id": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "address": "fa:16:3e:c2:28:35", "network": {"id": "04dd8b21-b308-442b-a440-e2406a2df90b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1080640877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b81aa7e-ae", "ovs_interfaceid": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "address": "fa:16:3e:d3:5d:61", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe49154e-53", "ovs_interfaceid": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "address": "fa:16:3e:52:f6:35", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953ab328-2c", "ovs_interfaceid": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "625dda14-0cd1-4178-b941-7e6a6a789011", "address": "fa:16:3e:c3:87:09", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625dda14-0c", "ovs_interfaceid": "625dda14-0cd1-4178-b941-7e6a6a789011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfa4c745-6e10-4e48-af69-924a0beade68", "address": "fa:16:3e:d7:98:4a", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa4c745-6e", "ovs_interfaceid": "dfa4c745-6e10-4e48-af69-924a0beade68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2465799c-3bee-44e6-bb98-a4db89e860a6", "address": "fa:16:3e:91:0d:66", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2465799c-3b", "ovs_interfaceid": "2465799c-3bee-44e6-bb98-a4db89e860a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "address": "fa:16:3e:35:7a:f3", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d194ea3-fd", "ovs_interfaceid": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Releasing lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG nova.compute.manager [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Instance network_info: |[{"id": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "address": "fa:16:3e:c2:28:35", "network": {"id": "04dd8b21-b308-442b-a440-e2406a2df90b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1080640877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b81aa7e-ae", "ovs_interfaceid": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "address": "fa:16:3e:d3:5d:61", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe49154e-53", "ovs_interfaceid": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "address": "fa:16:3e:52:f6:35", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953ab328-2c", "ovs_interfaceid": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "625dda14-0cd1-4178-b941-7e6a6a789011", "address": "fa:16:3e:c3:87:09", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625dda14-0c", "ovs_interfaceid": "625dda14-0cd1-4178-b941-7e6a6a789011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfa4c745-6e10-4e48-af69-924a0beade68", "address": "fa:16:3e:d7:98:4a", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa4c745-6e", "ovs_interfaceid": "dfa4c745-6e10-4e48-af69-924a0beade68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2465799c-3bee-44e6-bb98-a4db89e860a6", "address": "fa:16:3e:91:0d:66", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2465799c-3b", "ovs_interfaceid": "2465799c-3bee-44e6-bb98-a4db89e860a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "address": "fa:16:3e:35:7a:f3", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d194ea3-fd", "ovs_interfaceid": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Acquired lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG nova.network.neutron [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing network info cache for port 2465799c-3bee-44e6-bb98-a4db89e860a6 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "5a3b5455-983c-4c30-b229-8922443af209" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "5a3b5455-983c-4c30-b229-8922443af209" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "5a3b5455-983c-4c30-b229-8922443af209-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "5a3b5455-983c-4c30-b229-8922443af209-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "5a3b5455-983c-4c30-b229-8922443af209-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:41 user nova-compute[71364]: INFO nova.compute.manager [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Terminating instance
Apr 11 21:53:41 user nova-compute[71364]: DEBUG nova.compute.manager [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-ad84c7ae-72f0-42cf-a5a6-3b8e78f7b480 req-dda80f40-8f71-45b0-a88a-d2f0246ed9ee service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Received event network-vif-unplugged-70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ad84c7ae-72f0-42cf-a5a6-3b8e78f7b480 req-dda80f40-8f71-45b0-a88a-d2f0246ed9ee service nova] Acquiring lock "5a3b5455-983c-4c30-b229-8922443af209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ad84c7ae-72f0-42cf-a5a6-3b8e78f7b480 req-dda80f40-8f71-45b0-a88a-d2f0246ed9ee service nova] Lock "5a3b5455-983c-4c30-b229-8922443af209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ad84c7ae-72f0-42cf-a5a6-3b8e78f7b480 req-dda80f40-8f71-45b0-a88a-d2f0246ed9ee service nova] Lock "5a3b5455-983c-4c30-b229-8922443af209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-ad84c7ae-72f0-42cf-a5a6-3b8e78f7b480 req-dda80f40-8f71-45b0-a88a-d2f0246ed9ee service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] No waiting events found dispatching network-vif-unplugged-70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-ad84c7ae-72f0-42cf-a5a6-3b8e78f7b480 req-dda80f40-8f71-45b0-a88a-d2f0246ed9ee service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Received event network-vif-unplugged-70618f68-d426-45e0-aa51-0bffb5b512f5 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG nova.network.neutron [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updated VIF entry in instance network info cache for port 2465799c-3bee-44e6-bb98-a4db89e860a6. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG nova.network.neutron [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updating instance_info_cache with network_info: [{"id": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "address": "fa:16:3e:c2:28:35", "network": {"id": "04dd8b21-b308-442b-a440-e2406a2df90b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1080640877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b81aa7e-ae", "ovs_interfaceid": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "address": "fa:16:3e:d3:5d:61", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe49154e-53", "ovs_interfaceid": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "address": "fa:16:3e:52:f6:35", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953ab328-2c", "ovs_interfaceid": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "625dda14-0cd1-4178-b941-7e6a6a789011", "address": "fa:16:3e:c3:87:09", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625dda14-0c", "ovs_interfaceid": "625dda14-0cd1-4178-b941-7e6a6a789011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfa4c745-6e10-4e48-af69-924a0beade68", "address": "fa:16:3e:d7:98:4a", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa4c745-6e", "ovs_interfaceid": "dfa4c745-6e10-4e48-af69-924a0beade68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2465799c-3bee-44e6-bb98-a4db89e860a6", "address": "fa:16:3e:91:0d:66", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2465799c-3b", "ovs_interfaceid": "2465799c-3bee-44e6-bb98-a4db89e860a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "address": "fa:16:3e:35:7a:f3", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d194ea3-fd", "ovs_interfaceid": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Releasing lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-changed-3d194ea3-fda7-4516-8ace-0029b125ef0f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing instance network info cache due to event network-changed-3d194ea3-fda7-4516-8ace-0029b125ef0f. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Acquiring lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Acquired lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:53:41 user nova-compute[71364]: DEBUG nova.network.neutron [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing network info cache for port 3d194ea3-fda7-4516-8ace-0029b125ef0f {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:53:42 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Instance destroyed successfully.
Apr 11 21:53:42 user nova-compute[71364]: DEBUG nova.objects.instance [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lazy-loading 'resources' on Instance uuid 5a3b5455-983c-4c30-b229-8922443af209 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1308388397',display_name='tempest-TestVolumeSwap-server-1308388397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1308388397',id=8,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLlXnNVA1T5XsCFlI4PF3YuZ0GMWMMo0en+L1/ri7g5cFYsvnRV6z0onBgVKwLns7DAdeah2eE5mMYlaYFYiwoReMMqywci8aYgGj8Yr7LcTsA2BZumJ7YQpkoAerHUdQ==',key_name='tempest-keypair-2140712073',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be1a9b6214384320b7d75e890e569b01',ramdisk_id='',reservation_id='r-x0l58vmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1222066063',owner_user_name='tempest-TestVolumeSwap-1222066063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33f11dee7865404b9271be236429db1f',uuid=5a3b5455-983c-4c30-b229-8922443af209,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70618f68-d426-45e0-aa51-0bffb5b512f5", "address": "fa:16:3e:8e:c6:90", "network": {"id": "09ba5156-0533-4c89-98d7-01da7903e7fa", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1375351384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1a9b6214384320b7d75e890e569b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70618f68-d4", "ovs_interfaceid": "70618f68-d426-45e0-aa51-0bffb5b512f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Converting VIF {"id": "70618f68-d426-45e0-aa51-0bffb5b512f5", "address": "fa:16:3e:8e:c6:90", "network": {"id": "09ba5156-0533-4c89-98d7-01da7903e7fa", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1375351384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1a9b6214384320b7d75e890e569b01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70618f68-d4", "ovs_interfaceid": "70618f68-d426-45e0-aa51-0bffb5b512f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:c6:90,bridge_name='br-int',has_traffic_filtering=True,id=70618f68-d426-45e0-aa51-0bffb5b512f5,network=Network(09ba5156-0533-4c89-98d7-01da7903e7fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70618f68-d4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG os_vif [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:c6:90,bridge_name='br-int',has_traffic_filtering=True,id=70618f68-d426-45e0-aa51-0bffb5b512f5,network=Network(09ba5156-0533-4c89-98d7-01da7903e7fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70618f68-d4') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70618f68-d4, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:53:42 user nova-compute[71364]: INFO os_vif [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:c6:90,bridge_name='br-int',has_traffic_filtering=True,id=70618f68-d426-45e0-aa51-0bffb5b512f5,network=Network(09ba5156-0533-4c89-98d7-01da7903e7fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70618f68-d4')
Apr 11 21:53:42 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Deleting instance files /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209_del
Apr 11 21:53:42 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Deletion of /opt/stack/data/nova/instances/5a3b5455-983c-4c30-b229-8922443af209_del complete
Apr 11 21:53:42 user nova-compute[71364]: INFO nova.compute.manager [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 21:53:42 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 5a3b5455-983c-4c30-b229-8922443af209] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG nova.network.neutron [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updated VIF entry in instance network info cache for port 3d194ea3-fda7-4516-8ace-0029b125ef0f. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG nova.network.neutron [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updating instance_info_cache with network_info: [{"id": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "address": "fa:16:3e:c2:28:35", "network": {"id": "04dd8b21-b308-442b-a440-e2406a2df90b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1080640877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b81aa7e-ae", "ovs_interfaceid": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "address": "fa:16:3e:d3:5d:61", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe49154e-53", "ovs_interfaceid": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "address": "fa:16:3e:52:f6:35", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953ab328-2c", "ovs_interfaceid": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "625dda14-0cd1-4178-b941-7e6a6a789011", "address": "fa:16:3e:c3:87:09", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625dda14-0c", "ovs_interfaceid": "625dda14-0cd1-4178-b941-7e6a6a789011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfa4c745-6e10-4e48-af69-924a0beade68", "address": "fa:16:3e:d7:98:4a", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa4c745-6e", "ovs_interfaceid": "dfa4c745-6e10-4e48-af69-924a0beade68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2465799c-3bee-44e6-bb98-a4db89e860a6", "address": "fa:16:3e:91:0d:66", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2465799c-3b", "ovs_interfaceid": "2465799c-3bee-44e6-bb98-a4db89e860a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "address": "fa:16:3e:35:7a:f3", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d194ea3-fd", "ovs_interfaceid": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Releasing lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Received event network-vif-unplugged-22ba4180-8733-488d-93d4-71b404970953 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Acquiring lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Lock "d9341aca-d5c9-4c23-b8de-adb5360721bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] No waiting events found dispatching network-vif-unplugged-22ba4180-8733-488d-93d4-71b404970953 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Received event network-vif-unplugged-22ba4180-8733-488d-93d4-71b404970953 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:43 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Took 0.90 seconds to deallocate network for instance.
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:53:43 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Creating image(s)
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Ensure instance console log exists: /opt/stack/data/nova/instances/9304294d-fdba-4499-8af2-5a781c63b7c5/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Start _get_guest_xml network_info=[{"id": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "address": "fa:16:3e:c2:28:35", "network": {"id": "04dd8b21-b308-442b-a440-e2406a2df90b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1080640877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b81aa7e-ae", "ovs_interfaceid": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "address": "fa:16:3e:d3:5d:61", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe49154e-53", "ovs_interfaceid": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "address": "fa:16:3e:52:f6:35", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953ab328-2c", "ovs_interfaceid": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "625dda14-0cd1-4178-b941-7e6a6a789011", "address": "fa:16:3e:c3:87:09", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625dda14-0c", "ovs_interfaceid": "625dda14-0cd1-4178-b941-7e6a6a789011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfa4c745-6e10-4e48-af69-924a0beade68", "address": "fa:16:3e:d7:98:4a", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa4c745-6e", "ovs_interfaceid": "dfa4c745-6e10-4e48-af69-924a0beade68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2465799c-3bee-44e6-bb98-a4db89e860a6", "address": "fa:16:3e:91:0d:66", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2465799c-3b", "ovs_interfaceid": "2465799c-3bee-44e6-bb98-a4db89e860a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "address": "fa:16:3e:35:7a:f3", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d194ea3-fd", "ovs_interfaceid": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkIWocVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9304294d-fdba-4499-8af2-5a781c63b7c5', 'attached_at': '', 'detached_at': '', 'volume_id': '83a59923-4f76-4871-86e2-bf7037b54cf9', 'serial': '83a59923-4f76-4871-86e2-bf7037b54cf9'}, 'attachment_id': '50efb3dc-1016-4168-909e-ca3528f18be5', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHhbksGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9304294d-fdba-4499-8af2-5a781c63b7c5', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3890453-b356-4763-9d7c-ec5cca79e4ed', 'serial': 'f3890453-b356-4763-9d7c-ec5cca79e4ed'}, 'attachment_id': 'fa783d30-9df8-472a-bea2-bf7b8fed1b6a', 'mount_device': '/dev/vdb', 'boot_index': 1, 'guest_format': None, 'volume_type': None}, {'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOygnwGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9304294d-fdba-4499-8af2-5a781c63b7c5', 'attached_at': '', 'detached_at': '', 'volume_id': '1ac97080-f468-4233-9080-da800780218d', 'serial': '1ac97080-f468-4233-9080-da800780218d'}, 'attachment_id': '927e014b-a82b-46f0-93dc-49186cef2173', 'mount_device': '/dev/vdc', 'boot_index': 2, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.compute.manager [req-e28c4d4e-06ff-4af5-9da8-a086e0795cf1 req-175194bc-ca7c-49e9-a1e2-d4e5fe3ce091 service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Received event network-vif-deleted-70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:43 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:53:43 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkIWocVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:43 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:43 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:43 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9c760d-f94e-497e-a168-5fb756642944]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:53:43 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5197af9-413b-4eb2-971a-982c358c176d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9] added
Apr 11 21:53:43 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73f07a2-8141-4aeb-9709-d09379d07d77]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cf3154-6019-41dd-b925-4cad1a503054]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dkIWocVf {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dkIWocVf" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae73665-f661-49a7-a518-b9566cd7250b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dkIWocVf'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b9eca-1c74-44d3-854f-fab9ecfa61d8]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf421059-b5fa-46dc-b1ca-bcdd9f12abd2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:53:43 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 21:53:43 user nova-compute[71364]:  {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:43 user nova-compute[71364]: WARNING os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 21:53:43 user nova-compute[71364]: 
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c8744e-7ae8-401b-8ed1-fda993870cb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9, portal: 172.16.0.220,3260]
Apr 11 21:53:43 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9, portal: 172.16.0.220,3260] successful.
Apr 11 21:53:43 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cf9507-c6b6-458b-a91f-213553b9077b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[587f527d-1b65-4174-af8e-a476d4c43347]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:43 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:43 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45ce633-be05-4f79-826e-6bc48564337f]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkIWocVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:53:43 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Deleted allocations for instance 5a3b5455-983c-4c30-b229-8922443af209
Apr 11 21:53:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "5a3b5455-983c-4c30-b229-8922443af209" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.301s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.compute.manager [req-96d599e1-abd3-413f-839e-1da3bea2c995 req-d932527d-46b5-4367-8015-07f68f112f99 service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Received event network-vif-plugged-70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-96d599e1-abd3-413f-839e-1da3bea2c995 req-d932527d-46b5-4367-8015-07f68f112f99 service nova] Acquiring lock "5a3b5455-983c-4c30-b229-8922443af209-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-96d599e1-abd3-413f-839e-1da3bea2c995 req-d932527d-46b5-4367-8015-07f68f112f99 service nova] Lock "5a3b5455-983c-4c30-b229-8922443af209-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-96d599e1-abd3-413f-839e-1da3bea2c995 req-d932527d-46b5-4367-8015-07f68f112f99 service nova] Lock "5a3b5455-983c-4c30-b229-8922443af209-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:43 user nova-compute[71364]: DEBUG nova.compute.manager [req-96d599e1-abd3-413f-839e-1da3bea2c995 req-d932527d-46b5-4367-8015-07f68f112f99 service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] No waiting events found dispatching network-vif-plugged-70618f68-d426-45e0-aa51-0bffb5b512f5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:43 user nova-compute[71364]: WARNING nova.compute.manager [req-96d599e1-abd3-413f-839e-1da3bea2c995 req-d932527d-46b5-4367-8015-07f68f112f99 service nova] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Received unexpected event network-vif-plugged-70618f68-d426-45e0-aa51-0bffb5b512f5 for instance with vm_state deleted and task_state None.
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26131613264393663', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131613264393663', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHhbksGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:44 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:44 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:44 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a972ad3-7ae2-41d3-9a5d-5b6927ae9302]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:53:44 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0021dcd5-9cfa-4c1c-ab52-3c29cc788292]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed] added
Apr 11 21:53:44 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b87632-a920-4f28-b081-2ebd5fe7a268]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24a1262-a184-430c-9c8c-51b342c93022]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHhbksGX {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHhbksGX" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c864dab5-2abf-4fe7-8cf3-1fbe586b6992]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AHhbksGX'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a869b53d-8e50-4d6e-ba45-42f9c0cfce94]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cfd5c2-9fb0-42e4-94b3-0229896ee4b4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:44 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:44 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0826f0a7-9a8f-4d34-9ca4-cb9745c38889]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed, portal: 172.16.0.220,3260]
Apr 11 21:53:44 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed, portal: 172.16.0.220,3260] successful.
Apr 11 21:53:44 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[136b9ace-8a3f-4a64-a617-dca57d0a4a58]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[817c6f91-b242-4cc1-8cf6-f81b9477b771]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:45 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:45 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:45 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:45 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:53:45 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:53:45 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:53:45 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:53:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2480a4-0f68-495e-889c-7f6320343368]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:45 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:53:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHhbksGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26661333862636266', 'path': '/dev/sdc'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661333862636266', 'path': '/dev/sdc'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOygnwGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:46 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:46 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:46 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[61626225-13c9-4b26-a877-03d2847ef189]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:53:46 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6604968a-7f50-448a-93ea-1b28e5a3447b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d] added
Apr 11 21:53:46 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beac914-784d-4f20-9dd0-d49024526025]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[290ffbf8-bbd6-4064-b9bc-8f31f555695a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DOygnwGW {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DOygnwGW" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1980ece1-9023-4a0d-9e57-5fc621707956]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DOygnwGW'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cdc02c-95c6-4d61-864d-3886b05fa3fd]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[07207f38-5f6b-42ac-ae52-0ed412ab40a2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:46 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:46 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:46 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:46 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee100c6a-dfc7-4384-95ec-a4d078ff1b4b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d, portal: 172.16.0.220,3260]
Apr 11 21:53:46 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d, portal: 172.16.0.220,3260] successful.
Apr 11 21:53:46 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5093b4ba-50e4-4ce1-8c3e-333e08c99996]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[15adba50-f151-4ba3-8af9-3f53282d8205]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:46 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:46 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:53:46 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:46 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:46 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:53:46 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62aa33a-7d14-4d21-98f1-6c437d1c8e67]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:46 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: None {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOygnwGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23235653966363339', 'path': '/dev/sdd'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235653966363339', 'path': '/dev/sdd'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "address": "fa:16:3e:c2:28:35", "network": {"id": "04dd8b21-b308-442b-a440-e2406a2df90b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1080640877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b81aa7e-ae", "ovs_interfaceid": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "address": "fa:16:3e:c2:28:35", "network": {"id": "04dd8b21-b308-442b-a440-e2406a2df90b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1080640877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b81aa7e-ae", "ovs_interfaceid": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:28:35,bridge_name='br-int',has_traffic_filtering=True,id=9b81aa7e-ae9c-4e29-90c1-5060b7520348,network=Network(04dd8b21-b308-442b-a440-e2406a2df90b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b81aa7e-ae') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "address": "fa:16:3e:d3:5d:61", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe49154e-53", "ovs_interfaceid": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "address": "fa:16:3e:d3:5d:61", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe49154e-53", "ovs_interfaceid": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5d:61,bridge_name='br-int',has_traffic_filtering=True,id=be49154e-53c0-44f6-b010-8eba5fb9e0ce,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbe49154e-53') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "address": "fa:16:3e:52:f6:35", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953ab328-2c", "ovs_interfaceid": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "address": "fa:16:3e:52:f6:35", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953ab328-2c", "ovs_interfaceid": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:f6:35,bridge_name='br-int',has_traffic_filtering=True,id=953ab328-2cc0-42c1-ab3c-4a0062140f8f,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap953ab328-2c') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "625dda14-0cd1-4178-b941-7e6a6a789011", "address": "fa:16:3e:c3:87:09", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625dda14-0c", "ovs_interfaceid": "625dda14-0cd1-4178-b941-7e6a6a789011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "625dda14-0cd1-4178-b941-7e6a6a789011", "address": "fa:16:3e:c3:87:09", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625dda14-0c", "ovs_interfaceid": "625dda14-0cd1-4178-b941-7e6a6a789011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:87:09,bridge_name='br-int',has_traffic_filtering=True,id=625dda14-0cd1-4178-b941-7e6a6a789011,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625dda14-0c') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfa4c745-6e10-4e48-af69-924a0beade68", "address": "fa:16:3e:d7:98:4a", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa4c745-6e", "ovs_interfaceid": "dfa4c745-6e10-4e48-af69-924a0beade68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "dfa4c745-6e10-4e48-af69-924a0beade68", "address": "fa:16:3e:d7:98:4a", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa4c745-6e", "ovs_interfaceid": "dfa4c745-6e10-4e48-af69-924a0beade68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:98:4a,bridge_name='br-int',has_traffic_filtering=True,id=dfa4c745-6e10-4e48-af69-924a0beade68,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa4c745-6e') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2465799c-3bee-44e6-bb98-a4db89e860a6", "address": "fa:16:3e:91:0d:66", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2465799c-3b", "ovs_interfaceid": "2465799c-3bee-44e6-bb98-a4db89e860a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "2465799c-3bee-44e6-bb98-a4db89e860a6", "address": "fa:16:3e:91:0d:66", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2465799c-3b", "ovs_interfaceid": "2465799c-3bee-44e6-bb98-a4db89e860a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:0d:66,bridge_name='br-int',has_traffic_filtering=True,id=2465799c-3bee-44e6-bb98-a4db89e860a6,network=Network(3c27ec52-a464-45d9-8095-7c39b3dc2b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2465799c-3b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "address": "fa:16:3e:35:7a:f3", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d194ea3-fd", "ovs_interfaceid": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "address": "fa:16:3e:35:7a:f3", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d194ea3-fd", "ovs_interfaceid": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:7a:f3,bridge_name='br-int',has_traffic_filtering=True,id=3d194ea3-fda7-4516-8ace-0029b125ef0f,network=Network(3c27ec52-a464-45d9-8095-7c39b3dc2b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d194ea3-fd') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.objects.instance [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lazy-loading 'pci_devices' on Instance uuid 9304294d-fdba-4499-8af2-5a781c63b7c5 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:53:47 user nova-compute[71364]:   <uuid>9304294d-fdba-4499-8af2-5a781c63b7c5</uuid>
Apr 11 21:53:47 user nova-compute[71364]:   <name>instance-0000000d</name>
Apr 11 21:53:47 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:53:47 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:53:47 user nova-compute[71364]:   <metadata>
Apr 11 21:53:47 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:53:47 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:53:47 user nova-compute[71364]:       <nova:name>tempest-device-tagging-server-55291808</nova:name>
Apr 11 21:53:47 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:53:43</nova:creationTime>
Apr 11 21:53:47 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:53:47 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:53:47 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:53:47 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:53:47 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:53:47 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:53:47 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:53:47 user nova-compute[71364]:       <nova:owner>
Apr 11 21:53:47 user nova-compute[71364]:         <nova:user uuid="d79d201860f9413e91c6e5b80e82e7bf">tempest-TaggedBootDevicesTest-119528660-project-member</nova:user>
Apr 11 21:53:47 user nova-compute[71364]:         <nova:project uuid="c6b0f77f6e26488bb231a4148a769aa4">tempest-TaggedBootDevicesTest-119528660</nova:project>
Apr 11 21:53:47 user nova-compute[71364]:       </nova:owner>
Apr 11 21:53:47 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:53:47 user nova-compute[71364]:       <nova:ports>
Apr 11 21:53:47 user nova-compute[71364]:         <nova:port uuid="9b81aa7e-ae9c-4e29-90c1-5060b7520348">
Apr 11 21:53:47 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 21:53:47 user nova-compute[71364]:         </nova:port>
Apr 11 21:53:47 user nova-compute[71364]:         <nova:port uuid="be49154e-53c0-44f6-b010-8eba5fb9e0ce">
Apr 11 21:53:47 user nova-compute[71364]:           <nova:ip type="fixed" address="10.1.1.109" ipVersion="4"/>
Apr 11 21:53:47 user nova-compute[71364]:         </nova:port>
Apr 11 21:53:47 user nova-compute[71364]:         <nova:port uuid="953ab328-2cc0-42c1-ab3c-4a0062140f8f">
Apr 11 21:53:47 user nova-compute[71364]:           <nova:ip type="fixed" address="10.1.1.106" ipVersion="4"/>
Apr 11 21:53:47 user nova-compute[71364]:         </nova:port>
Apr 11 21:53:47 user nova-compute[71364]:         <nova:port uuid="625dda14-0cd1-4178-b941-7e6a6a789011">
Apr 11 21:53:47 user nova-compute[71364]:           <nova:ip type="fixed" address="10.1.1.251" ipVersion="4"/>
Apr 11 21:53:47 user nova-compute[71364]:         </nova:port>
Apr 11 21:53:47 user nova-compute[71364]:         <nova:port uuid="dfa4c745-6e10-4e48-af69-924a0beade68">
Apr 11 21:53:47 user nova-compute[71364]:           <nova:ip type="fixed" address="10.1.1.221" ipVersion="4"/>
Apr 11 21:53:47 user nova-compute[71364]:         </nova:port>
Apr 11 21:53:47 user nova-compute[71364]:         <nova:port uuid="2465799c-3bee-44e6-bb98-a4db89e860a6">
Apr 11 21:53:47 user nova-compute[71364]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 11 21:53:47 user nova-compute[71364]:         </nova:port>
Apr 11 21:53:47 user nova-compute[71364]:         <nova:port uuid="3d194ea3-fda7-4516-8ace-0029b125ef0f">
Apr 11 21:53:47 user nova-compute[71364]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 11 21:53:47 user nova-compute[71364]:         </nova:port>
Apr 11 21:53:47 user nova-compute[71364]:       </nova:ports>
Apr 11 21:53:47 user nova-compute[71364]:     </nova:instance>
Apr 11 21:53:47 user nova-compute[71364]:   </metadata>
Apr 11 21:53:47 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:53:47 user nova-compute[71364]:     <system>
Apr 11 21:53:47 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:53:47 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:53:47 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:53:47 user nova-compute[71364]:       <entry name="serial">9304294d-fdba-4499-8af2-5a781c63b7c5</entry>
Apr 11 21:53:47 user nova-compute[71364]:       <entry name="uuid">9304294d-fdba-4499-8af2-5a781c63b7c5</entry>
Apr 11 21:53:47 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:53:47 user nova-compute[71364]:     </system>
Apr 11 21:53:47 user nova-compute[71364]:   </sysinfo>
Apr 11 21:53:47 user nova-compute[71364]:   <os>
Apr 11 21:53:47 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:53:47 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:53:47 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:53:47 user nova-compute[71364]:   </os>
Apr 11 21:53:47 user nova-compute[71364]:   <features>
Apr 11 21:53:47 user nova-compute[71364]:     <acpi/>
Apr 11 21:53:47 user nova-compute[71364]:     <apic/>
Apr 11 21:53:47 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:53:47 user nova-compute[71364]:   </features>
Apr 11 21:53:47 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:53:47 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:53:47 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:53:47 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:53:47 user nova-compute[71364]:   </clock>
Apr 11 21:53:47 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:53:47 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:53:47 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:53:47 user nova-compute[71364]:   </cpu>
Apr 11 21:53:47 user nova-compute[71364]:   <devices>
Apr 11 21:53:47 user nova-compute[71364]:     <disk type="file" device="cdrom">
Apr 11 21:53:47 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none"/>
Apr 11 21:53:47 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/9304294d-fdba-4499-8af2-5a781c63b7c5/disk.config"/>
Apr 11 21:53:47 user nova-compute[71364]:       <target dev="hda" bus="ide"/>
Apr 11 21:53:47 user nova-compute[71364]:     </disk>
Apr 11 21:53:47 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 21:53:47 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:53:47 user nova-compute[71364]:       <source dev="/dev/sdb"/>
Apr 11 21:53:47 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:53:47 user nova-compute[71364]:       <serial>83a59923-4f76-4871-86e2-bf7037b54cf9</serial>
Apr 11 21:53:47 user nova-compute[71364]:     </disk>
Apr 11 21:53:47 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 21:53:47 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:53:47 user nova-compute[71364]:       <source dev="/dev/sdc"/>
Apr 11 21:53:47 user nova-compute[71364]:       <target dev="vdb" bus="virtio"/>
Apr 11 21:53:47 user nova-compute[71364]:       <serial>f3890453-b356-4763-9d7c-ec5cca79e4ed</serial>
Apr 11 21:53:47 user nova-compute[71364]:     </disk>
Apr 11 21:53:47 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 21:53:47 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:53:47 user nova-compute[71364]:       <source dev="/dev/sdd"/>
Apr 11 21:53:47 user nova-compute[71364]:       <target dev="vdc" bus="virtio"/>
Apr 11 21:53:47 user nova-compute[71364]:       <serial>1ac97080-f468-4233-9080-da800780218d</serial>
Apr 11 21:53:47 user nova-compute[71364]:     </disk>
Apr 11 21:53:47 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:53:47 user nova-compute[71364]:       <mac address="fa:16:3e:c2:28:35"/>
Apr 11 21:53:47 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:53:47 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:53:47 user nova-compute[71364]:       <target dev="tap9b81aa7e-ae"/>
Apr 11 21:53:47 user nova-compute[71364]:     </interface>
Apr 11 21:53:47 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:53:47 user nova-compute[71364]:       <mac address="fa:16:3e:d3:5d:61"/>
Apr 11 21:53:47 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:53:47 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:53:47 user nova-compute[71364]:       <target dev="tapbe49154e-53"/>
Apr 11 21:53:47 user nova-compute[71364]:     </interface>
Apr 11 21:53:47 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:53:47 user nova-compute[71364]:       <mac address="fa:16:3e:52:f6:35"/>
Apr 11 21:53:47 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:53:47 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:53:47 user nova-compute[71364]:       <target dev="tap953ab328-2c"/>
Apr 11 21:53:47 user nova-compute[71364]:     </interface>
Apr 11 21:53:47 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:53:47 user nova-compute[71364]:       <mac address="fa:16:3e:c3:87:09"/>
Apr 11 21:53:47 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:53:47 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:53:47 user nova-compute[71364]:       <target dev="tap625dda14-0c"/>
Apr 11 21:53:47 user nova-compute[71364]:     </interface>
Apr 11 21:53:47 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:53:47 user nova-compute[71364]:       <mac address="fa:16:3e:d7:98:4a"/>
Apr 11 21:53:47 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:53:47 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:53:47 user nova-compute[71364]:       <target dev="tapdfa4c745-6e"/>
Apr 11 21:53:47 user nova-compute[71364]:     </interface>
Apr 11 21:53:47 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:53:47 user nova-compute[71364]:       <mac address="fa:16:3e:91:0d:66"/>
Apr 11 21:53:47 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:53:47 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:53:47 user nova-compute[71364]:       <target dev="tap2465799c-3b"/>
Apr 11 21:53:47 user nova-compute[71364]:     </interface>
Apr 11 21:53:47 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:53:47 user nova-compute[71364]:       <mac address="fa:16:3e:35:7a:f3"/>
Apr 11 21:53:47 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:53:47 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:53:47 user nova-compute[71364]:       <target dev="tap3d194ea3-fd"/>
Apr 11 21:53:47 user nova-compute[71364]:     </interface>
Apr 11 21:53:47 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:53:47 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/9304294d-fdba-4499-8af2-5a781c63b7c5/console.log" append="off"/>
Apr 11 21:53:47 user nova-compute[71364]:     </serial>
Apr 11 21:53:47 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:53:47 user nova-compute[71364]:     <video>
Apr 11 21:53:47 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:53:47 user nova-compute[71364]:     </video>
Apr 11 21:53:47 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:53:47 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:53:47 user nova-compute[71364]:     </rng>
Apr 11 21:53:47 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:53:47 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:53:47 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:53:47 user nova-compute[71364]:     </memballoon>
Apr 11 21:53:47 user nova-compute[71364]:   </devices>
Apr 11 21:53:47 user nova-compute[71364]: </domain>
Apr 11 21:53:47 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "address": "fa:16:3e:c2:28:35", "network": {"id": "04dd8b21-b308-442b-a440-e2406a2df90b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1080640877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b81aa7e-ae", "ovs_interfaceid": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "address": "fa:16:3e:c2:28:35", "network": {"id": "04dd8b21-b308-442b-a440-e2406a2df90b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1080640877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b81aa7e-ae", "ovs_interfaceid": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:28:35,bridge_name='br-int',has_traffic_filtering=True,id=9b81aa7e-ae9c-4e29-90c1-5060b7520348,network=Network(04dd8b21-b308-442b-a440-e2406a2df90b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b81aa7e-ae') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG os_vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:28:35,bridge_name='br-int',has_traffic_filtering=True,id=9b81aa7e-ae9c-4e29-90c1-5060b7520348,network=Network(04dd8b21-b308-442b-a440-e2406a2df90b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b81aa7e-ae') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b81aa7e-ae, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9b81aa7e-ae, col_values=(('external_ids', {'iface-id': '9b81aa7e-ae9c-4e29-90c1-5060b7520348', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:28:35', 'vm-uuid': '9304294d-fdba-4499-8af2-5a781c63b7c5'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: INFO os_vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:28:35,bridge_name='br-int',has_traffic_filtering=True,id=9b81aa7e-ae9c-4e29-90c1-5060b7520348,network=Network(04dd8b21-b308-442b-a440-e2406a2df90b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b81aa7e-ae')
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "address": "fa:16:3e:d3:5d:61", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe49154e-53", "ovs_interfaceid": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "address": "fa:16:3e:d3:5d:61", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe49154e-53", "ovs_interfaceid": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5d:61,bridge_name='br-int',has_traffic_filtering=True,id=be49154e-53c0-44f6-b010-8eba5fb9e0ce,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbe49154e-53') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG os_vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5d:61,bridge_name='br-int',has_traffic_filtering=True,id=be49154e-53c0-44f6-b010-8eba5fb9e0ce,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbe49154e-53') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe49154e-53, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe49154e-53, col_values=(('external_ids', {'iface-id': 'be49154e-53c0-44f6-b010-8eba5fb9e0ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:5d:61', 'vm-uuid': '9304294d-fdba-4499-8af2-5a781c63b7c5'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: INFO os_vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5d:61,bridge_name='br-int',has_traffic_filtering=True,id=be49154e-53c0-44f6-b010-8eba5fb9e0ce,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbe49154e-53')
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "address": "fa:16:3e:52:f6:35", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953ab328-2c", "ovs_interfaceid": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "address": "fa:16:3e:52:f6:35", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953ab328-2c", "ovs_interfaceid": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:f6:35,bridge_name='br-int',has_traffic_filtering=True,id=953ab328-2cc0-42c1-ab3c-4a0062140f8f,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap953ab328-2c') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG os_vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f6:35,bridge_name='br-int',has_traffic_filtering=True,id=953ab328-2cc0-42c1-ab3c-4a0062140f8f,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap953ab328-2c') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap953ab328-2c, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap953ab328-2c, col_values=(('external_ids', {'iface-id': '953ab328-2cc0-42c1-ab3c-4a0062140f8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:f6:35', 'vm-uuid': '9304294d-fdba-4499-8af2-5a781c63b7c5'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: INFO os_vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f6:35,bridge_name='br-int',has_traffic_filtering=True,id=953ab328-2cc0-42c1-ab3c-4a0062140f8f,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap953ab328-2c')
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "625dda14-0cd1-4178-b941-7e6a6a789011", "address": "fa:16:3e:c3:87:09", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625dda14-0c", "ovs_interfaceid": "625dda14-0cd1-4178-b941-7e6a6a789011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "625dda14-0cd1-4178-b941-7e6a6a789011", "address": "fa:16:3e:c3:87:09", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625dda14-0c", "ovs_interfaceid": "625dda14-0cd1-4178-b941-7e6a6a789011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:87:09,bridge_name='br-int',has_traffic_filtering=True,id=625dda14-0cd1-4178-b941-7e6a6a789011,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625dda14-0c') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG os_vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:87:09,bridge_name='br-int',has_traffic_filtering=True,id=625dda14-0cd1-4178-b941-7e6a6a789011,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625dda14-0c') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap625dda14-0c, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap625dda14-0c, col_values=(('external_ids', {'iface-id': '625dda14-0cd1-4178-b941-7e6a6a789011', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:87:09', 'vm-uuid': '9304294d-fdba-4499-8af2-5a781c63b7c5'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: INFO os_vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:87:09,bridge_name='br-int',has_traffic_filtering=True,id=625dda14-0cd1-4178-b941-7e6a6a789011,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625dda14-0c')
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfa4c745-6e10-4e48-af69-924a0beade68", "address": "fa:16:3e:d7:98:4a", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa4c745-6e", "ovs_interfaceid": "dfa4c745-6e10-4e48-af69-924a0beade68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "dfa4c745-6e10-4e48-af69-924a0beade68", "address": "fa:16:3e:d7:98:4a", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa4c745-6e", "ovs_interfaceid": "dfa4c745-6e10-4e48-af69-924a0beade68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:98:4a,bridge_name='br-int',has_traffic_filtering=True,id=dfa4c745-6e10-4e48-af69-924a0beade68,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa4c745-6e') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG os_vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:98:4a,bridge_name='br-int',has_traffic_filtering=True,id=dfa4c745-6e10-4e48-af69-924a0beade68,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa4c745-6e') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfa4c745-6e, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfa4c745-6e, col_values=(('external_ids', {'iface-id': 'dfa4c745-6e10-4e48-af69-924a0beade68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:98:4a', 'vm-uuid': '9304294d-fdba-4499-8af2-5a781c63b7c5'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: INFO os_vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:98:4a,bridge_name='br-int',has_traffic_filtering=True,id=dfa4c745-6e10-4e48-af69-924a0beade68,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa4c745-6e')
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2465799c-3bee-44e6-bb98-a4db89e860a6", "address": "fa:16:3e:91:0d:66", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2465799c-3b", "ovs_interfaceid": "2465799c-3bee-44e6-bb98-a4db89e860a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "2465799c-3bee-44e6-bb98-a4db89e860a6", "address": "fa:16:3e:91:0d:66", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2465799c-3b", "ovs_interfaceid": "2465799c-3bee-44e6-bb98-a4db89e860a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:0d:66,bridge_name='br-int',has_traffic_filtering=True,id=2465799c-3bee-44e6-bb98-a4db89e860a6,network=Network(3c27ec52-a464-45d9-8095-7c39b3dc2b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2465799c-3b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG os_vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:0d:66,bridge_name='br-int',has_traffic_filtering=True,id=2465799c-3bee-44e6-bb98-a4db89e860a6,network=Network(3c27ec52-a464-45d9-8095-7c39b3dc2b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2465799c-3b') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2465799c-3b, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2465799c-3b, col_values=(('external_ids', {'iface-id': '2465799c-3bee-44e6-bb98-a4db89e860a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:0d:66', 'vm-uuid': '9304294d-fdba-4499-8af2-5a781c63b7c5'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "e627de16-3a8f-4510-8001-0e57a272b859" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.objects.instance [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'flavor' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: INFO os_vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:0d:66,bridge_name='br-int',has_traffic_filtering=True,id=2465799c-3bee-44e6-bb98-a4db89e860a6,network=Network(3c27ec52-a464-45d9-8095-7c39b3dc2b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2465799c-3b')
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "address": "fa:16:3e:35:7a:f3", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d194ea3-fd", "ovs_interfaceid": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "address": "fa:16:3e:35:7a:f3", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d194ea3-fd", "ovs_interfaceid": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:7a:f3,bridge_name='br-int',has_traffic_filtering=True,id=3d194ea3-fda7-4516-8ace-0029b125ef0f,network=Network(3c27ec52-a464-45d9-8095-7c39b3dc2b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d194ea3-fd') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG os_vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:7a:f3,bridge_name='br-int',has_traffic_filtering=True,id=3d194ea3-fda7-4516-8ace-0029b125ef0f,network=Network(3c27ec52-a464-45d9-8095-7c39b3dc2b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d194ea3-fd') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d194ea3-fd, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d194ea3-fd, col_values=(('external_ids', {'iface-id': '3d194ea3-fda7-4516-8ace-0029b125ef0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:7a:f3', 'vm-uuid': '9304294d-fdba-4499-8af2-5a781c63b7c5'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "e627de16-3a8f-4510-8001-0e57a272b859" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:47 user nova-compute[71364]: INFO os_vif [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:7a:f3,bridge_name='br-int',has_traffic_filtering=True,id=3d194ea3-fda7-4516-8ace-0029b125ef0f,network=Network(3c27ec52-a464-45d9-8095-7c39b3dc2b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d194ea3-fd')
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] No BDM found with device name hda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] No VIF found with MAC fa:16:3e:c2:28:35, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:53:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] No VIF found with MAC fa:16:3e:d7:98:4a, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:53:47 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Using config drive
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "e627de16-3a8f-4510-8001-0e57a272b859" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:48 user nova-compute[71364]: INFO nova.compute.manager [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Attaching volume ea22c351-542d-46cf-b3c4-9dc459161758 to /dev/vdb
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG os_brick.utils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22e792b-cf73-4267-8906-2f27dc515670]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:48 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Creating config drive at /opt/stack/data/nova/instances/9304294d-fdba-4499-8af2-5a781c63b7c5/disk.config
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9304294d-fdba-4499-8af2-5a781c63b7c5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpepe19hxz {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fece4b1-ba45-4814-86ff-b4cf807251ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9304294d-fdba-4499-8af2-5a781c63b7c5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpepe19hxz" returned: 0 in 0.055s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab11229-a6de-49dc-b18f-ac9657ecde57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c18f124-0331-4f2c-8e32-2f915845f326]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:53:48 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6f7758-4102-4097-a10b-7a3fabf86500]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG os_brick.utils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updating existing volume attachment record: 51ab4f78-93d4-49c9-b2a5-0a7a75bb1cd0 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG nova.objects.instance [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'flavor' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:48 user nova-compute[71364]: INFO nova.compute.manager [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Attaching volume 7f857075-bc19-44dc-a51d-42eec7e86722 to /dev/vdb
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG os_brick.utils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f383f4-cc49-4441-9fa4-1d146719736c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f6a996-7aaa-4148-b01b-676809e19162]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a9a5a8-da33-4f76-9669-23c223b0762a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd67764-1a3a-4445-9709-dca9427fdbba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:53:49 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51c101c-4d1f-46c4-a7a0-24b0186bd46b]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG os_brick.utils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating existing volume attachment record: 43a78576-194f-46cf-a35c-3ff2afa9f2b0 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating instance_info_cache with network_info: [{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-e8539df0-154b-4e16-8d1f-c37d34debd04 req-748172aa-a101-48f4-8d11-db0864f21223 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e8539df0-154b-4e16-8d1f-c37d34debd04 req-748172aa-a101-48f4-8d11-db0864f21223 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e8539df0-154b-4e16-8d1f-c37d34debd04 req-748172aa-a101-48f4-8d11-db0864f21223 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e8539df0-154b-4e16-8d1f-c37d34debd04 req-748172aa-a101-48f4-8d11-db0864f21223 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-e8539df0-154b-4e16-8d1f-c37d34debd04 req-748172aa-a101-48f4-8d11-db0864f21223 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:49 user nova-compute[71364]: WARNING nova.compute.manager [req-e8539df0-154b-4e16-8d1f-c37d34debd04 req-748172aa-a101-48f4-8d11-db0864f21223 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-9b81aa7e-ae9c-4e29-90c1-5060b7520348 for instance with vm_state building and task_state spawning.
Apr 11 21:53:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-8ce4cec2-f6e4-4df1-8c5a-c336a6596bd3 req-d68fecde-6fba-4cad-8c7c-7593b1df2b8f service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-953ab328-2cc0-42c1-ab3c-4a0062140f8f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8ce4cec2-f6e4-4df1-8c5a-c336a6596bd3 req-d68fecde-6fba-4cad-8c7c-7593b1df2b8f service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8ce4cec2-f6e4-4df1-8c5a-c336a6596bd3 req-d68fecde-6fba-4cad-8c7c-7593b1df2b8f service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8ce4cec2-f6e4-4df1-8c5a-c336a6596bd3 req-d68fecde-6fba-4cad-8c7c-7593b1df2b8f service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-8ce4cec2-f6e4-4df1-8c5a-c336a6596bd3 req-d68fecde-6fba-4cad-8c7c-7593b1df2b8f service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-953ab328-2cc0-42c1-ab3c-4a0062140f8f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:50 user nova-compute[71364]: WARNING nova.compute.manager [req-8ce4cec2-f6e4-4df1-8c5a-c336a6596bd3 req-d68fecde-6fba-4cad-8c7c-7593b1df2b8f service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-953ab328-2cc0-42c1-ab3c-4a0062140f8f for instance with vm_state building and task_state spawning.
Apr 11 21:53:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:52 user nova-compute[71364]: WARNING nova.compute.manager [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-9b81aa7e-ae9c-4e29-90c1-5060b7520348 for instance with vm_state building and task_state spawning.
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-be49154e-53c0-44f6-b010-8eba5fb9e0ce {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-be49154e-53c0-44f6-b010-8eba5fb9e0ce {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:52 user nova-compute[71364]: WARNING nova.compute.manager [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-be49154e-53c0-44f6-b010-8eba5fb9e0ce for instance with vm_state building and task_state spawning.
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-be49154e-53c0-44f6-b010-8eba5fb9e0ce {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-be49154e-53c0-44f6-b010-8eba5fb9e0ce {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:52 user nova-compute[71364]: WARNING nova.compute.manager [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-be49154e-53c0-44f6-b010-8eba5fb9e0ce for instance with vm_state building and task_state spawning.
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-2465799c-3bee-44e6-bb98-a4db89e860a6 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-2465799c-3bee-44e6-bb98-a4db89e860a6 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:52 user nova-compute[71364]: WARNING nova.compute.manager [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-2465799c-3bee-44e6-bb98-a4db89e860a6 for instance with vm_state building and task_state spawning.
Apr 11 21:53:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-953ab328-2cc0-42c1-ab3c-4a0062140f8f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-953ab328-2cc0-42c1-ab3c-4a0062140f8f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:52 user nova-compute[71364]: WARNING nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-953ab328-2cc0-42c1-ab3c-4a0062140f8f for instance with vm_state building and task_state spawning.
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-625dda14-0cd1-4178-b941-7e6a6a789011 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-625dda14-0cd1-4178-b941-7e6a6a789011 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:52 user nova-compute[71364]: WARNING nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-625dda14-0cd1-4178-b941-7e6a6a789011 for instance with vm_state building and task_state spawning.
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-625dda14-0cd1-4178-b941-7e6a6a789011 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-625dda14-0cd1-4178-b941-7e6a6a789011 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:52 user nova-compute[71364]: WARNING nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-625dda14-0cd1-4178-b941-7e6a6a789011 for instance with vm_state building and task_state spawning.
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-dfa4c745-6e10-4e48-af69-924a0beade68 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-dfa4c745-6e10-4e48-af69-924a0beade68 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:52 user nova-compute[71364]: WARNING nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-dfa4c745-6e10-4e48-af69-924a0beade68 for instance with vm_state building and task_state spawning.
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-dfa4c745-6e10-4e48-af69-924a0beade68 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-dfa4c745-6e10-4e48-af69-924a0beade68 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:52 user nova-compute[71364]: WARNING nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-dfa4c745-6e10-4e48-af69-924a0beade68 for instance with vm_state building and task_state spawning.
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-3d194ea3-fda7-4516-8ace-0029b125ef0f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-3d194ea3-fda7-4516-8ace-0029b125ef0f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:52 user nova-compute[71364]: WARNING nova.compute.manager [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-3d194ea3-fda7-4516-8ace-0029b125ef0f for instance with vm_state building and task_state spawning.
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QGxMCIZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:53 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:53 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:53 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[93754b7b-c48c-4e90-8b14-3b863f9c3737]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:53:53 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6732322-676d-4dd3-9f9f-d58d0babfa1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758] added
Apr 11 21:53:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc893ed-f514-4a65-bef0-a86193aac862]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[431984b8-00a0-41a6-8251-60b4bb543340]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QGxMCIZV {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QGxMCIZV" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc7e107-d0d2-45c7-8309-5f881872827e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QGxMCIZV'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc117d0-7b2d-49f4-a95c-cf9f23123bbf]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[585518e6-ac37-40fa-bd8f-2cbd0b0d4266]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:53 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:53 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:53:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:53 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:53 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:53:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29fc72d-9e63-4e6c-ab72-1c511c200138]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758, portal: 172.16.0.220,3260]
Apr 11 21:53:53 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758, portal: 172.16.0.220,3260] successful.
Apr 11 21:53:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[488a46f1-efc5-4a9a-a580-f855892b678d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20a3cee-7aaa-4fe4-9144-f98140d071ad]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:53 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:53 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:53:53 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:53:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:53 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:53 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:53:53 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:53:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[391d03e1-2eaa-44b6-a168-cc01ffe187d8]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QGxMCIZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250018.927233, d9341aca-d5c9-4c23-b8de-adb5360721bf => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:53:53 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] VM Stopped (Lifecycle Event)
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-81e31534-31c2-4c15-b967-245b603a8656 None None] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:53:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-6e35cef3-8f4b-4952-9dae-e2d02ec9c731 req-392c77a2-32bc-4267-89f3-5319d0ca7149 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-2465799c-3bee-44e6-bb98-a4db89e860a6 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6e35cef3-8f4b-4952-9dae-e2d02ec9c731 req-392c77a2-32bc-4267-89f3-5319d0ca7149 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6e35cef3-8f4b-4952-9dae-e2d02ec9c731 req-392c77a2-32bc-4267-89f3-5319d0ca7149 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6e35cef3-8f4b-4952-9dae-e2d02ec9c731 req-392c77a2-32bc-4267-89f3-5319d0ca7149 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-6e35cef3-8f4b-4952-9dae-e2d02ec9c731 req-392c77a2-32bc-4267-89f3-5319d0ca7149 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-2465799c-3bee-44e6-bb98-a4db89e860a6 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:54 user nova-compute[71364]: WARNING nova.compute.manager [req-6e35cef3-8f4b-4952-9dae-e2d02ec9c731 req-392c77a2-32bc-4267-89f3-5319d0ca7149 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-2465799c-3bee-44e6-bb98-a4db89e860a6 for instance with vm_state building and task_state spawning.
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250034.174959, 9304294d-fdba-4499-8af2-5a781c63b7c5 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:53:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] VM Resumed (Lifecycle Event)
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:53:54 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Instance spawned successfully.
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:53:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250034.1784992, 9304294d-fdba-4499-8af2-5a781c63b7c5 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:53:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] VM Started (Lifecycle Event)
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.791s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] <== connect_volume: return (1793ms) {'type': 'block', 'scsi_wwn': '26532646331663932', 'path': '/dev/sde'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532646331663932', 'path': '/dev/sde'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-89726cba-3a5c-4358-9248-4559b9201aca req-54994874-57c0-42af-8cc7-e79504a750bb service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-3d194ea3-fda7-4516-8ace-0029b125ef0f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-89726cba-3a5c-4358-9248-4559b9201aca req-54994874-57c0-42af-8cc7-e79504a750bb service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-89726cba-3a5c-4358-9248-4559b9201aca req-54994874-57c0-42af-8cc7-e79504a750bb service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-89726cba-3a5c-4358-9248-4559b9201aca req-54994874-57c0-42af-8cc7-e79504a750bb service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-89726cba-3a5c-4358-9248-4559b9201aca req-54994874-57c0-42af-8cc7-e79504a750bb service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-3d194ea3-fda7-4516-8ace-0029b125ef0f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:54 user nova-compute[71364]: WARNING nova.compute.manager [req-89726cba-3a5c-4358-9248-4559b9201aca req-54994874-57c0-42af-8cc7-e79504a750bb service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-3d194ea3-fda7-4516-8ace-0029b125ef0f for instance with vm_state building and task_state spawning.
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHfSpTKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:54 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:54 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:54 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:54 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:53:54 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7979MB free_disk=26.487098693847656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.objects.instance [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'flavor' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a5a86f-fe2d-44f1-840c-a7c7738b6e21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:53:54 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:53:54 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:53:54 user nova-compute[71364]:   <source dev="/dev/sde"/>
Apr 11 21:53:54 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:53:54 user nova-compute[71364]:   <serial>ea22c351-542d-46cf-b3c4-9dc459161758</serial>
Apr 11 21:53:54 user nova-compute[71364]: </disk>
Apr 11 21:53:54 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2359fa06-7384-4b32-b231-aed17619b3d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722] added
Apr 11 21:53:54 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa155218-0f7c-42dd-a7ec-9e1e0f220159]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[760eadd3-2ffd-4009-828c-a841a079c246]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHfSpTKF {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:54 user nova-compute[71364]: INFO nova.compute.manager [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Took 11.73 seconds to spawn the instance on the hypervisor.
Apr 11 21:53:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHfSpTKF" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa76b794-88ec-46e4-911a-55321d58fdb9]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XHfSpTKF'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance e627de16-3a8f-4510-8001-0e57a272b859 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76315af2-c4b9-4ad5-98ea-81826524d63e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[49992e0f-b56d-4def-bb5e-9d65cb0189a1]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f12221-63e7-4849-a77c-60072b65d36a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:55 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:55 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:53:55 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:53:55 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:55 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:55 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:53:55 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:53:55 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:55 user nova-compute[71364]: INFO nova.compute.manager [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Took 27.12 seconds to build instance.
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.235s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1102a515-97c9-472c-94cd-69e4a0e75b5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260]
Apr 11 21:53:55 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260] successful.
Apr 11 21:53:55 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a710df7-2b49-4faa-93f2-47c1f9c91d21]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bddf806-9443-43f7-a6f6-849f9e3ede28]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:55 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:55 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:53:55 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:53:55 user nova-compute[71364]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:53:55 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:55 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:55 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:53:55 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:53:55 user nova-compute[71364]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:53:55 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13bc063-3362-4530-a7ae-5d4c79d10fe6]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHfSpTKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] No VIF found with MAC fa:16:3e:3e:1d:93, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "e627de16-3a8f-4510-8001-0e57a272b859" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.524s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:56 user nova-compute[71364]: INFO nova.compute.manager [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Rescuing
Apr 11 21:53:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquired lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG nova.network.neutron [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23730373764336663', 'path': '/dev/sdf'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730373764336663', 'path': '/dev/sdf'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG nova.objects.instance [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'flavor' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:53:56 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:53:56 user nova-compute[71364]:   <source dev="/dev/sdf"/>
Apr 11 21:53:56 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:53:56 user nova-compute[71364]:   <serial>7f857075-bc19-44dc-a51d-42eec7e86722</serial>
Apr 11 21:53:56 user nova-compute[71364]: </disk>
Apr 11 21:53:56 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No VIF found with MAC fa:16:3e:44:2c:d8, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG nova.network.neutron [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updating instance_info_cache with network_info: [{"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Releasing lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.913s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250022.2287877, 5a3b5455-983c-4c30-b229-8922443af209 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:53:57 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 5a3b5455-983c-4c30-b229-8922443af209] VM Stopped (Lifecycle Event)
Apr 11 21:53:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-9f33b642-f8b6-4980-abeb-f21c7aa3753f None None] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-06b46f86-4c0c-4a0f-8bc9-cc8624817e78 req-5786fe76-445a-44ec-913e-7246d4383e50 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-vif-unplugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-06b46f86-4c0c-4a0f-8bc9-cc8624817e78 req-5786fe76-445a-44ec-913e-7246d4383e50 service nova] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-06b46f86-4c0c-4a0f-8bc9-cc8624817e78 req-5786fe76-445a-44ec-913e-7246d4383e50 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-06b46f86-4c0c-4a0f-8bc9-cc8624817e78 req-5786fe76-445a-44ec-913e-7246d4383e50 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-06b46f86-4c0c-4a0f-8bc9-cc8624817e78 req-5786fe76-445a-44ec-913e-7246d4383e50 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] No waiting events found dispatching network-vif-unplugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:57 user nova-compute[71364]: WARNING nova.compute.manager [req-06b46f86-4c0c-4a0f-8bc9-cc8624817e78 req-5786fe76-445a-44ec-913e-7246d4383e50 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received unexpected event network-vif-unplugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance with vm_state active and task_state rescuing.
Apr 11 21:53:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:53:57 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Instance destroyed successfully.
Apr 11 21:53:57 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Attempting a stable device rescue
Apr 11 21:53:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71364) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Instance directory exists: not creating {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 21:53:57 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Creating image(s)
Apr 11 21:53:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "/opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "/opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "/opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG nova.objects.instance [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'trusted_certs' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "1f36cc6e1b1d327397d32b02a1e67716e622652c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "1f36cc6e1b1d327397d32b02a1e67716e622652c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c.part --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:58 user nova-compute[71364]: INFO nova.compute.manager [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Rebuilding instance
Apr 11 21:53:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c.part --force-share --output=json" returned: 0 in 0.154s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG nova.virt.images [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 26b30c98-b62d-41bb-9171-ce44a8c082a2 was qcow2, converting to raw {{(pid=71364) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c.part /opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c.converted {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c.part /opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c.converted" returned: 0 in 0.161s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c.converted --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'pci_requests' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'resources' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'migration_context' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71364) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c.converted --force-share --output=json" returned: 0 in 0.160s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "1f36cc6e1b1d327397d32b02a1e67716e622652c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.119s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "1f36cc6e1b1d327397d32b02a1e67716e622652c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "1f36cc6e1b1d327397d32b02a1e67716e622652c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c --force-share --output=json" returned: 0 in 0.160s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c,backing_fmt=raw /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk.rescue {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c,backing_fmt=raw /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk.rescue" returned: 0 in 0.055s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "1f36cc6e1b1d327397d32b02a1e67716e622652c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.objects.instance [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'migration_context' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Start _get_guest_xml network_info=[{"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "vif_mac": "fa:16:3e:3e:1d:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '26b30c98-b62d-41bb-9171-ce44a8c082a2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QGxMCIZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'e627de16-3a8f-4510-8001-0e57a272b859', 'attached_at': '', 'detached_at': '', 'volume_id': 'ea22c351-542d-46cf-b3c4-9dc459161758', 'serial': 'ea22c351-542d-46cf-b3c4-9dc459161758'}, 'attachment_id': '51ab4f78-93d4-49c9-b2a5-0a7a75bb1cd0', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.objects.instance [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'resources' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.objects.instance [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'numa_topology' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:59 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:53:59 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.objects.instance [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'vcpu_model' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QGxMCIZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:59 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:59 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:59 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc980a9-3dc9-4c80-b960-39fbff6b58b1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QGxMCIZV\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 21:53:59 user nova-compute[71364]: node.name = iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758
Apr 11 21:53:59 user nova-compute[71364]: node.tpgt = -1
Apr 11 21:53:59 user nova-compute[71364]: node.startup = automatic
Apr 11 21:53:59 user nova-compute[71364]: node.leading_login = No
Apr 11 21:53:59 user nova-compute[71364]: iface.iscsi_ifacename = default
Apr 11 21:53:59 user nova-compute[71364]: iface.net_ifacename = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.ipaddress = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.prefix_len = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.hwaddress = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.transport_name = tcp
Apr 11 21:53:59 user nova-compute[71364]: iface.initiatorname = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.state = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.vlan_id = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.vlan_priority = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.vlan_state = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.iface_num = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.mtu = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.port = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.bootproto = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.subnet_mask = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.gateway = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.dhcp_alt_client_id = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.dhcp_dns = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.dhcp_learn_iqn = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.dhcp_vendor_id_state = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.dhcp_vendor_id = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.dhcp_slp_da = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.fragmentation = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.gratuitous_arp = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.incoming_forwarding = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.tos_state = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.tos = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.ttl = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.delayed_ack = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.tcp_nagle = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.tcp_wsf_state = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.tcp_wsf = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.tcp_timer_scale = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.tcp_timestamp = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.redirect = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.def_task_mgmt_timeout = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.header_digest = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.data_digest = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.immediate_data = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.initial_r2t = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.data_seq_inorder = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.data_pdu_inorder = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.erl = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.max_receive_data_len = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.first_burst_len = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.max_outstanding_r2t = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.max_burst_len = 0
Apr 11 21:53:59 user nova-compute[71364]: iface.chap_auth = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.bidi_chap = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.strict_login_compliance = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.discovery_auth = <empty>
Apr 11 21:53:59 user nova-compute[71364]: iface.discovery_logout = <empty>
Apr 11 21:53:59 user nova-compute[71364]: node.discovery_address = <empty>
Apr 11 21:53:59 user nova-compute[71364]: node.discovery_port = 0
Apr 11 21:53:59 user nova-compute[71364]: node.discovery_type = static
Apr 11 21:53:59 user nova-compute[71364]: node.session.initial_cmdsn = 0
Apr 11 21:53:59 user nova-compute[71364]: node.session.initial_login_retry_max = 8
Apr 11 21:53:59 user nova-compute[71364]: node.session.xmit_thread_priority = -20
Apr 11 21:53:59 user nova-compute[71364]: node.session.cmds_max = 128
Apr 11 21:53:59 user nova-compute[71364]: node.session.queue_depth = 32
Apr 11 21:53:59 user nova-compute[71364]: node.session.nr_sessions = 1
Apr 11 21:53:59 user nova-compute[71364]: node.session.auth.authmethod = CHAP
Apr 11 21:53:59 user nova-compute[71364]: node.session.auth.username = QGxMCIZV
Apr 11 21:53:59 user nova-compute[71364]: node.session.auth.password = ***
Apr 11 21:53:59 user nova-compute[71364]: node.session.auth.username_in = <empty>
Apr 11 21:53:59 user nova-compute[71364]: node.session.auth.password_in = <empty>
Apr 11 21:53:59 user nova-compute[71364]: node.session.auth.chap_algs = MD5
Apr 11 21:53:59 user nova-compute[71364]: node.session.timeo.replacement_timeout = 120
Apr 11 21:53:59 user nova-compute[71364]: node.session.err_timeo.abort_timeout = 15
Apr 11 21:53:59 user nova-compute[71364]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 21:53:59 user nova-compute[71364]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 21:53:59 user nova-compute[71364]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 21:53:59 user nova-compute[71364]: node.session.iscsi.FastAbort = Yes
Apr 11 21:53:59 user nova-compute[71364]: node.session.iscsi.InitialR2T = No
Apr 11 21:53:59 user nova-compute[71364]: node.session.iscsi.ImmediateData = Yes
Apr 11 21:53:59 user nova-compute[71364]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 21:53:59 user nova-compute[71364]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 21:53:59 user nova-compute[71364]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 21:53:59 user nova-compute[71364]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 21:53:59 user nova-compute[71364]: node.session.iscsi.MaxConnections = 1
Apr 11 21:53:59 user nova-compute[71364]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 21:53:59 user nova-compute[71364]: node.session.iscsi.ERL = 0
Apr 11 21:53:59 user nova-compute[71364]: node.session.scan = manual
Apr 11 21:53:59 user nova-compute[71364]: node.session.reopen_max = 0
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].address = 172.16.0.220
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].port = 3260
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].startup = manual
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].tcp.window_size = 524288
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].tcp.type_of_service = 0
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].timeo.logout_timeout = 15
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].timeo.login_timeout = 15
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].timeo.auth_timeout = 45
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].iscsi.DataDigest = None
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].iscsi.IFMarker = No
Apr 11 21:53:59 user nova-compute[71364]: node.conn[0].iscsi.OFMarker = No
Apr 11 21:53:59 user nova-compute[71364]: # END RECORD
Apr 11 21:53:59 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d21b9ff-450e-409a-95b3-35a22eec8145]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-6a0e123c-1b80-49dc-aaf0-51185091d08d req-d32ccaa7-0379-4575-850d-e2a791b4154f service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-unplugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6a0e123c-1b80-49dc-aaf0-51185091d08d req-d32ccaa7-0379-4575-850d-e2a791b4154f service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6a0e123c-1b80-49dc-aaf0-51185091d08d req-d32ccaa7-0379-4575-850d-e2a791b4154f service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6a0e123c-1b80-49dc-aaf0-51185091d08d req-d32ccaa7-0379-4575-850d-e2a791b4154f service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-6a0e123c-1b80-49dc-aaf0-51185091d08d req-d32ccaa7-0379-4575-850d-e2a791b4154f service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-unplugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:59 user nova-compute[71364]: WARNING nova.compute.manager [req-6a0e123c-1b80-49dc-aaf0-51185091d08d req-d32ccaa7-0379-4575-850d-e2a791b4154f service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-unplugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state active and task_state rebuilding.
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4ed32b-f310-44ab-8cda-fc155a1503b7]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QGxMCIZV {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QGxMCIZV" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18df8d5-4662-47ec-b18a-913ece630be1]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QGxMCIZV'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-8dda6aac-4e2e-4548-b8a9-e7693e6e0248 req-8b4c2f8d-485d-408b-a783-eb2173ac95cd service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8dda6aac-4e2e-4548-b8a9-e7693e6e0248 req-8b4c2f8d-485d-408b-a783-eb2173ac95cd service nova] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8dda6aac-4e2e-4548-b8a9-e7693e6e0248 req-8b4c2f8d-485d-408b-a783-eb2173ac95cd service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8dda6aac-4e2e-4548-b8a9-e7693e6e0248 req-8b4c2f8d-485d-408b-a783-eb2173ac95cd service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-8dda6aac-4e2e-4548-b8a9-e7693e6e0248 req-8b4c2f8d-485d-408b-a783-eb2173ac95cd service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] No waiting events found dispatching network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:53:59 user nova-compute[71364]: WARNING nova.compute.manager [req-8dda6aac-4e2e-4548-b8a9-e7693e6e0248 req-8b4c2f8d-485d-408b-a783-eb2173ac95cd service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received unexpected event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance with vm_state active and task_state rescuing.
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec84234-1771-4c21-8c92-5426d2f78131]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5db809d-4e86-48e8-a43c-1eb3f7538b54]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:53:59 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:53:59 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.170s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] HCTL ('36', '0', '0', 0) found on session 16 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[64db6cdb-60fe-4cdb-8e9b-2f8c1253b33b]: (4, ('0 0 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Searching for a device in session 16 and hctl ('36', '0', '0', 0) yield: sde {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QGxMCIZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.196s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '26532646331663932', 'path': '/dev/sde'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532646331663932', 'path': '/dev/sde'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-405286600',display_name='tempest-ServerStableDeviceRescueTest-server-405286600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-405286600',id=3,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8UEH6m5UnzB3x3GKZuWdKxk/7Mog1k30VHYME5xmsB2oMV/EGVRbZfXe3hxruVI/c3+NH5gZP1pkgcqm0HyGY2eX0pPoQEeEsvHRlFY/LgN3qSuIuwhuAHFHFnkPGb1w==',key_name='tempest-keypair-301380016',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:50:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2a0320bbd424d039ac56f377f51132d',ramdisk_id='',reservation_id='r-qbwexep8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1504592746',owner_user_name='tempest-ServerStableDeviceRescueTest-1504592746-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:52:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='176bb0cf6ea849bfbe97f8275ec2f932',uuid=e627de16-3a8f-4510-8001-0e57a272b859,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "vif_mac": "fa:16:3e:3e:1d:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Converting VIF {"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "vif_mac": "fa:16:3e:3e:1d:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:1d:93,bridge_name='br-int',has_traffic_filtering=True,id=20b9e448-55b1-49a6-8c39-08b2ab9755eb,network=Network(a9945e2c-fe10-4952-83c1-81f938544bce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b9e448-55') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.objects.instance [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'pci_devices' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:53:59 user nova-compute[71364]:   <uuid>e627de16-3a8f-4510-8001-0e57a272b859</uuid>
Apr 11 21:53:59 user nova-compute[71364]:   <name>instance-00000003</name>
Apr 11 21:53:59 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:53:59 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:53:59 user nova-compute[71364]:   <metadata>
Apr 11 21:53:59 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:53:59 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:53:59 user nova-compute[71364]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-405286600</nova:name>
Apr 11 21:53:59 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:53:59</nova:creationTime>
Apr 11 21:53:59 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:53:59 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:53:59 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:53:59 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:53:59 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:53:59 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:53:59 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:53:59 user nova-compute[71364]:       <nova:owner>
Apr 11 21:53:59 user nova-compute[71364]:         <nova:user uuid="176bb0cf6ea849bfbe97f8275ec2f932">tempest-ServerStableDeviceRescueTest-1504592746-project-member</nova:user>
Apr 11 21:53:59 user nova-compute[71364]:         <nova:project uuid="b2a0320bbd424d039ac56f377f51132d">tempest-ServerStableDeviceRescueTest-1504592746</nova:project>
Apr 11 21:53:59 user nova-compute[71364]:       </nova:owner>
Apr 11 21:53:59 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:53:59 user nova-compute[71364]:       <nova:ports>
Apr 11 21:53:59 user nova-compute[71364]:         <nova:port uuid="20b9e448-55b1-49a6-8c39-08b2ab9755eb">
Apr 11 21:53:59 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 21:53:59 user nova-compute[71364]:         </nova:port>
Apr 11 21:53:59 user nova-compute[71364]:       </nova:ports>
Apr 11 21:53:59 user nova-compute[71364]:     </nova:instance>
Apr 11 21:53:59 user nova-compute[71364]:   </metadata>
Apr 11 21:53:59 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:53:59 user nova-compute[71364]:     <system>
Apr 11 21:53:59 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:53:59 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:53:59 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:53:59 user nova-compute[71364]:       <entry name="serial">e627de16-3a8f-4510-8001-0e57a272b859</entry>
Apr 11 21:53:59 user nova-compute[71364]:       <entry name="uuid">e627de16-3a8f-4510-8001-0e57a272b859</entry>
Apr 11 21:53:59 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:53:59 user nova-compute[71364]:     </system>
Apr 11 21:53:59 user nova-compute[71364]:   </sysinfo>
Apr 11 21:53:59 user nova-compute[71364]:   <os>
Apr 11 21:53:59 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:53:59 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:53:59 user nova-compute[71364]:   </os>
Apr 11 21:53:59 user nova-compute[71364]:   <features>
Apr 11 21:53:59 user nova-compute[71364]:     <acpi/>
Apr 11 21:53:59 user nova-compute[71364]:     <apic/>
Apr 11 21:53:59 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:53:59 user nova-compute[71364]:   </features>
Apr 11 21:53:59 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:53:59 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:53:59 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:53:59 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:53:59 user nova-compute[71364]:   </clock>
Apr 11 21:53:59 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:53:59 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:53:59 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:53:59 user nova-compute[71364]:   </cpu>
Apr 11 21:53:59 user nova-compute[71364]:   <devices>
Apr 11 21:53:59 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:53:59 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:53:59 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk"/>
Apr 11 21:53:59 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:53:59 user nova-compute[71364]:     </disk>
Apr 11 21:53:59 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 21:53:59 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:53:59 user nova-compute[71364]:       <source dev="/dev/sde"/>
Apr 11 21:53:59 user nova-compute[71364]:       <target dev="vdb" bus="virtio"/>
Apr 11 21:53:59 user nova-compute[71364]:       <serial>ea22c351-542d-46cf-b3c4-9dc459161758</serial>
Apr 11 21:53:59 user nova-compute[71364]:     </disk>
Apr 11 21:53:59 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:53:59 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:53:59 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk.rescue"/>
Apr 11 21:53:59 user nova-compute[71364]:       <target dev="vdc" bus="virtio"/>
Apr 11 21:53:59 user nova-compute[71364]:       <boot order="1"/>
Apr 11 21:53:59 user nova-compute[71364]:     </disk>
Apr 11 21:53:59 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:53:59 user nova-compute[71364]:       <mac address="fa:16:3e:3e:1d:93"/>
Apr 11 21:53:59 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:53:59 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:53:59 user nova-compute[71364]:       <target dev="tap20b9e448-55"/>
Apr 11 21:53:59 user nova-compute[71364]:     </interface>
Apr 11 21:53:59 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:53:59 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/console.log" append="off"/>
Apr 11 21:53:59 user nova-compute[71364]:     </serial>
Apr 11 21:53:59 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:53:59 user nova-compute[71364]:     <video>
Apr 11 21:53:59 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:53:59 user nova-compute[71364]:     </video>
Apr 11 21:53:59 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:53:59 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:53:59 user nova-compute[71364]:     </rng>
Apr 11 21:53:59 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:53:59 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:53:59 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:53:59 user nova-compute[71364]:     </memballoon>
Apr 11 21:53:59 user nova-compute[71364]:   </devices>
Apr 11 21:53:59 user nova-compute[71364]: </domain>
Apr 11 21:53:59 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:53:59 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Instance destroyed successfully.
Apr 11 21:53:59 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance destroyed successfully.
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] No VIF found with MAC fa:16:3e:3e:1d:93, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:53:59 user nova-compute[71364]: INFO nova.compute.manager [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Detaching volume 7f857075-bc19-44dc-a51d-42eec7e86722
Apr 11 21:53:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:53:59 user nova-compute[71364]: INFO nova.virt.block_device [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Attempting to driver detach volume 7f857075-bc19-44dc-a51d-42eec7e86722 from mountpoint /dev/vdb
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Attempting to detach device vdb from instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:53:59 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:53:59 user nova-compute[71364]:   <source dev="/dev/sdf"/>
Apr 11 21:53:59 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:53:59 user nova-compute[71364]:   <serial>7f857075-bc19-44dc-a51d-42eec7e86722</serial>
Apr 11 21:53:59 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:53:59 user nova-compute[71364]: </disk>
Apr 11 21:53:59 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:53:59 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully detached device vdb from instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb from the persistent domain config.
Apr 11 21:53:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHfSpTKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:53:59 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[500048d1-2ee0-4e7c-b4b8-b50da268bea0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:53:59 user nova-compute[71364]: No targets found.
Apr 11 21:53:59 user nova-compute[71364]: iSNS:
Apr 11 21:53:59 user nova-compute[71364]: No targets found.
Apr 11 21:53:59 user nova-compute[71364]: STATIC:
Apr 11 21:53:59 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758
Apr 11 21:53:59 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:53:59 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:53:59 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed
Apr 11 21:53:59 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:53:59 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:53:59 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d
Apr 11 21:53:59 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:53:59 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:53:59 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722
Apr 11 21:53:59 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:53:59 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:53:59 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9
Apr 11 21:53:59 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:53:59 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:53:59 user nova-compute[71364]: FIRMWARE:
Apr 11 21:53:59 user nova-compute[71364]: No targets found.
Apr 11 21:53:59 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:53:59 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:53:59 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[10077aa8-db2f-4630-b584-9149ddee3906]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[39054b24-f193-4f94-b4da-e4ac713dcd07]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:53:59 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:53:59 user nova-compute[71364]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:53:59 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bd079b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722'): ({'sdf'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Removing single pathed devices sdf {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f2928c-fae3-4b56-a256-7f1a12180f91]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:53:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3427dd9f-3dd9-46ac-9b59-906cbfc0fdf5]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flushing IO for device /dev/sdf {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9add1d8-d383-4a07-bd92-fc248211d8e9]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7d2537-d804-4cc6-9226-72465af23b71]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] SCSI volumes sdf have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d320ea50-2bdd-4896-ac67-228e1b2f1ee3]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8be022-ff2b-4bc4-8d6c-2b52c34bf092]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260]
Apr 11 21:54:00 user nova-compute[71364]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260] successful.
Apr 11 21:54:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b065522a-5681-46fb-bac8-f695fa541d5e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== disconnect_volume: return (397ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:54:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:01 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance destroyed successfully.
Apr 11 21:54:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842337295',display_name='tempest-ServerActionsTestJSON-server-349398715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842337295',id=4,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:50:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-c34k408a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=5ff9bbaf-1a5e-4acd-aca3-d956728312cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_vif [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6144f13d-b4, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:01 user nova-compute[71364]: INFO os_vif [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4')
Apr 11 21:54:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHfSpTKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:54:01 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccb7357-5342-4016-865e-9389f45307cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:54:01 user nova-compute[71364]: No targets found.
Apr 11 21:54:01 user nova-compute[71364]: iSNS:
Apr 11 21:54:01 user nova-compute[71364]: No targets found.
Apr 11 21:54:01 user nova-compute[71364]: STATIC:
Apr 11 21:54:01 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758
Apr 11 21:54:01 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:54:01 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:54:01 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed
Apr 11 21:54:01 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:54:01 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:54:01 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d
Apr 11 21:54:01 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:54:01 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:54:01 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9
Apr 11 21:54:01 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:54:01 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:54:01 user nova-compute[71364]: FIRMWARE:
Apr 11 21:54:01 user nova-compute[71364]: No targets found.
Apr 11 21:54:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:54:01 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:54:01 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-8bd40fc6-5acd-49ad-8813-b6df4fdb9ac8 req-1f121ef2-7fc7-4e5b-b75c-6ec4971461d8 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8bd40fc6-5acd-49ad-8813-b6df4fdb9ac8 req-1f121ef2-7fc7-4e5b-b75c-6ec4971461d8 service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8bd40fc6-5acd-49ad-8813-b6df4fdb9ac8 req-1f121ef2-7fc7-4e5b-b75c-6ec4971461d8 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8bd40fc6-5acd-49ad-8813-b6df4fdb9ac8 req-1f121ef2-7fc7-4e5b-b75c-6ec4971461d8 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-8bd40fc6-5acd-49ad-8813-b6df4fdb9ac8 req-1f121ef2-7fc7-4e5b-b75c-6ec4971461d8 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:01 user nova-compute[71364]: WARNING nova.compute.manager [req-8bd40fc6-5acd-49ad-8813-b6df4fdb9ac8 req-1f121ef2-7fc7-4e5b-b75c-6ec4971461d8 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state active and task_state rebuilding.
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[571173a5-5f36-4211-9f15-cd113082fc04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db06128-f732-49dd-a158-f5f4592255ef]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:54:01 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:54:01 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:54:01 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:54:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:54:01 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:54:01 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:54:01 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:54:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bf4404670>, {}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Disconnecting from: [] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== disconnect_volume: return (78ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:54:01 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Deleting instance files /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb_del
Apr 11 21:54:01 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Deletion of /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb_del complete
Apr 11 21:54:01 user nova-compute[71364]: INFO nova.virt.block_device [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Booting with volume 7f857075-bc19-44dc-a51d-42eec7e86722 at /dev/vdb
Apr 11 21:54:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-2b805f5c-48d3-4d95-9330-91f95e279bc7 req-0ea8200d-a110-4334-bbaf-567ba7dd4ce7 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2b805f5c-48d3-4d95-9330-91f95e279bc7 req-0ea8200d-a110-4334-bbaf-567ba7dd4ce7 service nova] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2b805f5c-48d3-4d95-9330-91f95e279bc7 req-0ea8200d-a110-4334-bbaf-567ba7dd4ce7 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2b805f5c-48d3-4d95-9330-91f95e279bc7 req-0ea8200d-a110-4334-bbaf-567ba7dd4ce7 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-2b805f5c-48d3-4d95-9330-91f95e279bc7 req-0ea8200d-a110-4334-bbaf-567ba7dd4ce7 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] No waiting events found dispatching network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:01 user nova-compute[71364]: WARNING nova.compute.manager [req-2b805f5c-48d3-4d95-9330-91f95e279bc7 req-0ea8200d-a110-4334-bbaf-567ba7dd4ce7 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received unexpected event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance with vm_state active and task_state rescuing.
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.utils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[842841bc-0330-49c9-a78e-f351642cb52c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.036s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b81a4b-5d21-4a5d-9d9b-da253ef759eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5550dd16-adaf-43b0-9a3d-ab7643eadcd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[667f2a69-3f66-4fbb-896a-ef4e6135e4c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:54:01 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:54:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[64083174-fed4-45d6-8e2e-763167d1b268]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG os_brick.utils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating existing volume attachment record: 35da08fd-b753-408f-be25-d287f0786bda {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-073cfaa0-9249-4f02-b7b4-e312fc28e33b req-5a818d34-97e3-45d3-b77c-260c62f553a5 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-073cfaa0-9249-4f02-b7b4-e312fc28e33b req-5a818d34-97e3-45d3-b77c-260c62f553a5 service nova] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-073cfaa0-9249-4f02-b7b4-e312fc28e33b req-5a818d34-97e3-45d3-b77c-260c62f553a5 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-073cfaa0-9249-4f02-b7b4-e312fc28e33b req-5a818d34-97e3-45d3-b77c-260c62f553a5 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-073cfaa0-9249-4f02-b7b4-e312fc28e33b req-5a818d34-97e3-45d3-b77c-260c62f553a5 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] No waiting events found dispatching network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:03 user nova-compute[71364]: WARNING nova.compute.manager [req-073cfaa0-9249-4f02-b7b4-e312fc28e33b req-5a818d34-97e3-45d3-b77c-260c62f553a5 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received unexpected event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance with vm_state active and task_state rescuing.
Apr 11 21:54:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for e627de16-3a8f-4510-8001-0e57a272b859 due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 21:54:03 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250043.9211698, e627de16-3a8f-4510-8001-0e57a272b859 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:54:03 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] VM Resumed (Lifecycle Event)
Apr 11 21:54:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:54:03 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 21:54:03 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250043.9267528, e627de16-3a8f-4510-8001-0e57a272b859 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:54:03 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] VM Started (Lifecycle Event)
Apr 11 21:54:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:54:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:05 user nova-compute[71364]: INFO nova.compute.manager [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] instance snapshotting
Apr 11 21:54:05 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Beginning live snapshot process
Apr 11 21:54:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json -f qcow2 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json -f qcow2" returned: 0 in 0.152s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json -f qcow2 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json -f qcow2" returned: 0 in 0.161s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "d4aa732e-7598-443e-96f3-11e7f271e06d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "d4aa732e-7598-443e-96f3-11e7f271e06d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.147s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1lk9x27p/573ae6426522483db891b990d6574b65.delta 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp1lk9x27p/573ae6426522483db891b990d6574b65.delta 1073741824" returned: 0 in 0.053s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:54:06 user nova-compute[71364]: INFO nova.compute.claims [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Claim successful on node user
Apr 11 21:54:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:54:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Creating image(s)
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "/opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "/opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.157s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:54:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:54:06 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.148s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG nova.policy [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10feb9f12b2b4742808e9c06da370031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196d39dc81df44958f2e403a3a41030f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk 1073741824" returned: 0 in 0.067s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:54:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Creating image(s)
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "/opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "/opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] COPY block job progress, current cursor: 196608 final cursor: 43843584 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.188s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.183s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Cannot resize image /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Ensure instance console log exists: /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Start _get_guest_xml network_info=[{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHfSpTKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ff9bbaf-1a5e-4acd-aca3-d956728312cb', 'attached_at': '', 'detached_at': '', 'volume_id': '7f857075-bc19-44dc-a51d-42eec7e86722', 'serial': '7f857075-bc19-44dc-a51d-42eec7e86722'}, 'attachment_id': '35da08fd-b753-408f-be25-d287f0786bda', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:54:07 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 11 21:54:07 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.159s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHfSpTKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:54:07 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:54:07 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:54:07 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk 1073741824" returned: 0 in 0.093s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fda94e-a5bd-4318-965f-aa48ffc3d2af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:54:07 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[610d66f1-68ab-4328-b6ac-3dc5468517a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722] added
Apr 11 21:54:07 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f07fb5f-0b4e-4a81-88b2-6c058f3f3080]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3a6aa8-3871-4af4-b98d-bfed38c3b3ef]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:54:07 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHfSpTKF {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHfSpTKF" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3264fc7-1aaf-42fa-9e39-4da4c338d02c]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XHfSpTKF'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeed9ce-1bc9-4595-827d-bfdf3dd3c4f8]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.189s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2a194c-5adb-4ee3-9d6c-7732c28ce872]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:54:07 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:54:07 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:54:07 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:54:07 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:54:07 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:54:07 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:54:07 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:54:07 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1lk9x27p/573ae6426522483db891b990d6574b65.delta /opt/stack/data/nova/instances/snapshots/tmp1lk9x27p/573ae6426522483db891b990d6574b65 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a46218-a335-4984-982d-146d044c6279]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260]
Apr 11 21:54:07 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260] successful.
Apr 11 21:54:07 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e2d07b-f9dd-4ff9-afd4-d6c4ae5d81f8]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Cannot resize image /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lazy-loading 'migration_context' on Instance uuid d4aa732e-7598-443e-96f3-11e7f271e06d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd49c60-c1f9-439b-a4bd-86f744a06a5d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:54:07 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:54:07 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:54:07 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:54:07 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:54:07 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:54:07 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:54:07 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:54:07 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:54:07 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:54:07 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Ensure instance console log exists: /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f2c523-a81e-4ecb-9c9d-ba4185821650]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHfSpTKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:54:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp1lk9x27p/573ae6426522483db891b990d6574b65.delta /opt/stack/data/nova/instances/snapshots/tmp1lk9x27p/573ae6426522483db891b990d6574b65" returned: 0 in 0.262s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:07 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Snapshot extracted, beginning image upload
Apr 11 21:54:08 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Successfully created port: 2bd3732b-13bc-4017-891e-c808fd4d9b1f {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '23730373764336663', 'path': '/dev/sdf'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730373764336663', 'path': '/dev/sdf'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842337295',display_name='tempest-ServerActionsTestJSON-server-349398715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842337295',id=4,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:50:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-c34k408a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:54:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=5ff9bbaf-1a5e-4acd-aca3-d956728312cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:54:08 user nova-compute[71364]:   <uuid>5ff9bbaf-1a5e-4acd-aca3-d956728312cb</uuid>
Apr 11 21:54:08 user nova-compute[71364]:   <name>instance-00000004</name>
Apr 11 21:54:08 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:54:08 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:54:08 user nova-compute[71364]:   <metadata>
Apr 11 21:54:08 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:54:08 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:54:08 user nova-compute[71364]:       <nova:name>tempest-ServerActionsTestJSON-server-349398715</nova:name>
Apr 11 21:54:08 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:54:07</nova:creationTime>
Apr 11 21:54:08 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:54:08 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:54:08 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:54:08 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:54:08 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:54:08 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:54:08 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:54:08 user nova-compute[71364]:       <nova:owner>
Apr 11 21:54:08 user nova-compute[71364]:         <nova:user uuid="939785ef89cb491aae3df4f411b2543d">tempest-ServerActionsTestJSON-434853204-project-member</nova:user>
Apr 11 21:54:08 user nova-compute[71364]:         <nova:project uuid="c9fff7d112a94e7da6bf166a6f628fed">tempest-ServerActionsTestJSON-434853204</nova:project>
Apr 11 21:54:08 user nova-compute[71364]:       </nova:owner>
Apr 11 21:54:08 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:54:08 user nova-compute[71364]:       <nova:ports>
Apr 11 21:54:08 user nova-compute[71364]:         <nova:port uuid="6144f13d-b463-46ef-b75b-d2d982198b72">
Apr 11 21:54:08 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 21:54:08 user nova-compute[71364]:         </nova:port>
Apr 11 21:54:08 user nova-compute[71364]:       </nova:ports>
Apr 11 21:54:08 user nova-compute[71364]:     </nova:instance>
Apr 11 21:54:08 user nova-compute[71364]:   </metadata>
Apr 11 21:54:08 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:54:08 user nova-compute[71364]:     <system>
Apr 11 21:54:08 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:54:08 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:54:08 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:54:08 user nova-compute[71364]:       <entry name="serial">5ff9bbaf-1a5e-4acd-aca3-d956728312cb</entry>
Apr 11 21:54:08 user nova-compute[71364]:       <entry name="uuid">5ff9bbaf-1a5e-4acd-aca3-d956728312cb</entry>
Apr 11 21:54:08 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:54:08 user nova-compute[71364]:     </system>
Apr 11 21:54:08 user nova-compute[71364]:   </sysinfo>
Apr 11 21:54:08 user nova-compute[71364]:   <os>
Apr 11 21:54:08 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:54:08 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:54:08 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:54:08 user nova-compute[71364]:   </os>
Apr 11 21:54:08 user nova-compute[71364]:   <features>
Apr 11 21:54:08 user nova-compute[71364]:     <acpi/>
Apr 11 21:54:08 user nova-compute[71364]:     <apic/>
Apr 11 21:54:08 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:54:08 user nova-compute[71364]:   </features>
Apr 11 21:54:08 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:54:08 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:54:08 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:54:08 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:54:08 user nova-compute[71364]:   </clock>
Apr 11 21:54:08 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:54:08 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:54:08 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:54:08 user nova-compute[71364]:   </cpu>
Apr 11 21:54:08 user nova-compute[71364]:   <devices>
Apr 11 21:54:08 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:54:08 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:54:08 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk"/>
Apr 11 21:54:08 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:54:08 user nova-compute[71364]:     </disk>
Apr 11 21:54:08 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 21:54:08 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:54:08 user nova-compute[71364]:       <source dev="/dev/sdf"/>
Apr 11 21:54:08 user nova-compute[71364]:       <target dev="vdb" bus="virtio"/>
Apr 11 21:54:08 user nova-compute[71364]:       <serial>7f857075-bc19-44dc-a51d-42eec7e86722</serial>
Apr 11 21:54:08 user nova-compute[71364]:     </disk>
Apr 11 21:54:08 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:54:08 user nova-compute[71364]:       <mac address="fa:16:3e:44:2c:d8"/>
Apr 11 21:54:08 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:54:08 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:54:08 user nova-compute[71364]:       <target dev="tap6144f13d-b4"/>
Apr 11 21:54:08 user nova-compute[71364]:     </interface>
Apr 11 21:54:08 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:54:08 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/console.log" append="off"/>
Apr 11 21:54:08 user nova-compute[71364]:     </serial>
Apr 11 21:54:08 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:54:08 user nova-compute[71364]:     <video>
Apr 11 21:54:08 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:54:08 user nova-compute[71364]:     </video>
Apr 11 21:54:08 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:54:08 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:54:08 user nova-compute[71364]:     </rng>
Apr 11 21:54:08 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:54:08 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:54:08 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:54:08 user nova-compute[71364]:     </memballoon>
Apr 11 21:54:08 user nova-compute[71364]:   </devices>
Apr 11 21:54:08 user nova-compute[71364]: </domain>
Apr 11 21:54:08 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842337295',display_name='tempest-ServerActionsTestJSON-server-349398715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842337295',id=4,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:50:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-c34k408a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:54:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=5ff9bbaf-1a5e-4acd-aca3-d956728312cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG os_vif [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6144f13d-b4, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6144f13d-b4, col_values=(('external_ids', {'iface-id': '6144f13d-b463-46ef-b75b-d2d982198b72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:2c:d8', 'vm-uuid': '5ff9bbaf-1a5e-4acd-aca3-d956728312cb'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:54:08 user nova-compute[71364]: INFO os_vif [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4')
Apr 11 21:54:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:54:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:54:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No VIF found with MAC fa:16:3e:44:2c:d8, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:54:09 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Successfully updated port: 2bd3732b-13bc-4017-891e-c808fd4d9b1f {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:54:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "refresh_cache-d4aa732e-7598-443e-96f3-11e7f271e06d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:54:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquired lock "refresh_cache-d4aa732e-7598-443e-96f3-11e7f271e06d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:54:09 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:54:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-ea3eb527-e086-4da6-ac46-203edcc4c618 req-f04c92d6-66b2-4e26-a11d-a2ad922c3402 service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Received event network-changed-2bd3732b-13bc-4017-891e-c808fd4d9b1f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-ea3eb527-e086-4da6-ac46-203edcc4c618 req-f04c92d6-66b2-4e26-a11d-a2ad922c3402 service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Refreshing instance network info cache due to event network-changed-2bd3732b-13bc-4017-891e-c808fd4d9b1f. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:54:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ea3eb527-e086-4da6-ac46-203edcc4c618 req-f04c92d6-66b2-4e26-a11d-a2ad922c3402 service nova] Acquiring lock "refresh_cache-d4aa732e-7598-443e-96f3-11e7f271e06d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:54:09 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Updating instance_info_cache with network_info: [{"id": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "address": "fa:16:3e:6d:6c:7d", "network": {"id": "4542f6c1-28e3-484e-b117-6f228cb1ad27", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532935468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "196d39dc81df44958f2e403a3a41030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd3732b-13", "ovs_interfaceid": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Releasing lock "refresh_cache-d4aa732e-7598-443e-96f3-11e7f271e06d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Instance network_info: |[{"id": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "address": "fa:16:3e:6d:6c:7d", "network": {"id": "4542f6c1-28e3-484e-b117-6f228cb1ad27", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532935468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "196d39dc81df44958f2e403a3a41030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd3732b-13", "ovs_interfaceid": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ea3eb527-e086-4da6-ac46-203edcc4c618 req-f04c92d6-66b2-4e26-a11d-a2ad922c3402 service nova] Acquired lock "refresh_cache-d4aa732e-7598-443e-96f3-11e7f271e06d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.network.neutron [req-ea3eb527-e086-4da6-ac46-203edcc4c618 req-f04c92d6-66b2-4e26-a11d-a2ad922c3402 service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Refreshing network info cache for port 2bd3732b-13bc-4017-891e-c808fd4d9b1f {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Start _get_guest_xml network_info=[{"id": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "address": "fa:16:3e:6d:6c:7d", "network": {"id": "4542f6c1-28e3-484e-b117-6f228cb1ad27", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532935468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "196d39dc81df44958f2e403a3a41030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd3732b-13", "ovs_interfaceid": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:54:10 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:54:10 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1286349447',display_name='tempest-VolumesActionsTest-instance-1286349447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1286349447',id=14,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='196d39dc81df44958f2e403a3a41030f',ramdisk_id='',reservation_id='r-u9x1gfox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-606140534',owner_user_name='tempest-VolumesActionsTest-606140534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:54:07Z,user_data=None,user_id='10feb9f12b2b4742808e9c06da370031',uuid=d4aa732e-7598-443e-96f3-11e7f271e06d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "address": "fa:16:3e:6d:6c:7d", "network": {"id": "4542f6c1-28e3-484e-b117-6f228cb1ad27", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532935468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "196d39dc81df44958f2e403a3a41030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd3732b-13", "ovs_interfaceid": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Converting VIF {"id": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "address": "fa:16:3e:6d:6c:7d", "network": {"id": "4542f6c1-28e3-484e-b117-6f228cb1ad27", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532935468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "196d39dc81df44958f2e403a3a41030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd3732b-13", "ovs_interfaceid": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6c:7d,bridge_name='br-int',has_traffic_filtering=True,id=2bd3732b-13bc-4017-891e-c808fd4d9b1f,network=Network(4542f6c1-28e3-484e-b117-6f228cb1ad27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd3732b-13') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lazy-loading 'pci_devices' on Instance uuid d4aa732e-7598-443e-96f3-11e7f271e06d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:54:10 user nova-compute[71364]:   <uuid>d4aa732e-7598-443e-96f3-11e7f271e06d</uuid>
Apr 11 21:54:10 user nova-compute[71364]:   <name>instance-0000000e</name>
Apr 11 21:54:10 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:54:10 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:54:10 user nova-compute[71364]:   <metadata>
Apr 11 21:54:10 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:54:10 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:54:10 user nova-compute[71364]:       <nova:name>tempest-VolumesActionsTest-instance-1286349447</nova:name>
Apr 11 21:54:10 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:54:10</nova:creationTime>
Apr 11 21:54:10 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:54:10 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:54:10 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:54:10 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:54:10 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:54:10 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:54:10 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:54:10 user nova-compute[71364]:       <nova:owner>
Apr 11 21:54:10 user nova-compute[71364]:         <nova:user uuid="10feb9f12b2b4742808e9c06da370031">tempest-VolumesActionsTest-606140534-project-member</nova:user>
Apr 11 21:54:10 user nova-compute[71364]:         <nova:project uuid="196d39dc81df44958f2e403a3a41030f">tempest-VolumesActionsTest-606140534</nova:project>
Apr 11 21:54:10 user nova-compute[71364]:       </nova:owner>
Apr 11 21:54:10 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:54:10 user nova-compute[71364]:       <nova:ports>
Apr 11 21:54:10 user nova-compute[71364]:         <nova:port uuid="2bd3732b-13bc-4017-891e-c808fd4d9b1f">
Apr 11 21:54:10 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 21:54:10 user nova-compute[71364]:         </nova:port>
Apr 11 21:54:10 user nova-compute[71364]:       </nova:ports>
Apr 11 21:54:10 user nova-compute[71364]:     </nova:instance>
Apr 11 21:54:10 user nova-compute[71364]:   </metadata>
Apr 11 21:54:10 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:54:10 user nova-compute[71364]:     <system>
Apr 11 21:54:10 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:54:10 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:54:10 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:54:10 user nova-compute[71364]:       <entry name="serial">d4aa732e-7598-443e-96f3-11e7f271e06d</entry>
Apr 11 21:54:10 user nova-compute[71364]:       <entry name="uuid">d4aa732e-7598-443e-96f3-11e7f271e06d</entry>
Apr 11 21:54:10 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:54:10 user nova-compute[71364]:     </system>
Apr 11 21:54:10 user nova-compute[71364]:   </sysinfo>
Apr 11 21:54:10 user nova-compute[71364]:   <os>
Apr 11 21:54:10 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:54:10 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:54:10 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:54:10 user nova-compute[71364]:   </os>
Apr 11 21:54:10 user nova-compute[71364]:   <features>
Apr 11 21:54:10 user nova-compute[71364]:     <acpi/>
Apr 11 21:54:10 user nova-compute[71364]:     <apic/>
Apr 11 21:54:10 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:54:10 user nova-compute[71364]:   </features>
Apr 11 21:54:10 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:54:10 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:54:10 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:54:10 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:54:10 user nova-compute[71364]:   </clock>
Apr 11 21:54:10 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:54:10 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:54:10 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:54:10 user nova-compute[71364]:   </cpu>
Apr 11 21:54:10 user nova-compute[71364]:   <devices>
Apr 11 21:54:10 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:54:10 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:54:10 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk"/>
Apr 11 21:54:10 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:54:10 user nova-compute[71364]:     </disk>
Apr 11 21:54:10 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:54:10 user nova-compute[71364]:       <mac address="fa:16:3e:6d:6c:7d"/>
Apr 11 21:54:10 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:54:10 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:54:10 user nova-compute[71364]:       <target dev="tap2bd3732b-13"/>
Apr 11 21:54:10 user nova-compute[71364]:     </interface>
Apr 11 21:54:10 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:54:10 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/console.log" append="off"/>
Apr 11 21:54:10 user nova-compute[71364]:     </serial>
Apr 11 21:54:10 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:54:10 user nova-compute[71364]:     <video>
Apr 11 21:54:10 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:54:10 user nova-compute[71364]:     </video>
Apr 11 21:54:10 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:54:10 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:54:10 user nova-compute[71364]:     </rng>
Apr 11 21:54:10 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:54:10 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:54:10 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:54:10 user nova-compute[71364]:     </memballoon>
Apr 11 21:54:10 user nova-compute[71364]:   </devices>
Apr 11 21:54:10 user nova-compute[71364]: </domain>
Apr 11 21:54:10 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1286349447',display_name='tempest-VolumesActionsTest-instance-1286349447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1286349447',id=14,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='196d39dc81df44958f2e403a3a41030f',ramdisk_id='',reservation_id='r-u9x1gfox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-606140534',owner_user_name='tempest-VolumesActionsTest-606140534-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:54:07Z,user_data=None,user_id='10feb9f12b2b4742808e9c06da370031',uuid=d4aa732e-7598-443e-96f3-11e7f271e06d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "address": "fa:16:3e:6d:6c:7d", "network": {"id": "4542f6c1-28e3-484e-b117-6f228cb1ad27", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532935468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "196d39dc81df44958f2e403a3a41030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd3732b-13", "ovs_interfaceid": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Converting VIF {"id": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "address": "fa:16:3e:6d:6c:7d", "network": {"id": "4542f6c1-28e3-484e-b117-6f228cb1ad27", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532935468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "196d39dc81df44958f2e403a3a41030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd3732b-13", "ovs_interfaceid": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6c:7d,bridge_name='br-int',has_traffic_filtering=True,id=2bd3732b-13bc-4017-891e-c808fd4d9b1f,network=Network(4542f6c1-28e3-484e-b117-6f228cb1ad27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd3732b-13') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG os_vif [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6c:7d,bridge_name='br-int',has_traffic_filtering=True,id=2bd3732b-13bc-4017-891e-c808fd4d9b1f,network=Network(4542f6c1-28e3-484e-b117-6f228cb1ad27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd3732b-13') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bd3732b-13, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2bd3732b-13, col_values=(('external_ids', {'iface-id': '2bd3732b-13bc-4017-891e-c808fd4d9b1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:6c:7d', 'vm-uuid': 'd4aa732e-7598-443e-96f3-11e7f271e06d'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:10 user nova-compute[71364]: INFO os_vif [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6c:7d,bridge_name='br-int',has_traffic_filtering=True,id=2bd3732b-13bc-4017-891e-c808fd4d9b1f,network=Network(4542f6c1-28e3-484e-b117-6f228cb1ad27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd3732b-13')
Apr 11 21:54:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:54:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] No VIF found with MAC fa:16:3e:6d:6c:7d, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:54:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:11 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Snapshot image upload complete
Apr 11 21:54:11 user nova-compute[71364]: INFO nova.compute.manager [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Took 5.94 seconds to snapshot the instance on the hypervisor.
Apr 11 21:54:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:11 user nova-compute[71364]: DEBUG nova.network.neutron [req-ea3eb527-e086-4da6-ac46-203edcc4c618 req-f04c92d6-66b2-4e26-a11d-a2ad922c3402 service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Updated VIF entry in instance network info cache for port 2bd3732b-13bc-4017-891e-c808fd4d9b1f. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:54:11 user nova-compute[71364]: DEBUG nova.network.neutron [req-ea3eb527-e086-4da6-ac46-203edcc4c618 req-f04c92d6-66b2-4e26-a11d-a2ad922c3402 service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Updating instance_info_cache with network_info: [{"id": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "address": "fa:16:3e:6d:6c:7d", "network": {"id": "4542f6c1-28e3-484e-b117-6f228cb1ad27", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532935468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "196d39dc81df44958f2e403a3a41030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd3732b-13", "ovs_interfaceid": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:54:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ea3eb527-e086-4da6-ac46-203edcc4c618 req-f04c92d6-66b2-4e26-a11d-a2ad922c3402 service nova] Releasing lock "refresh_cache-d4aa732e-7598-443e-96f3-11e7f271e06d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:54:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-4f2a95d9-59dd-409b-8d31-c91dbfe00896 req-663fe1cc-0269-4f82-844c-3bc39fd9df61 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4f2a95d9-59dd-409b-8d31-c91dbfe00896 req-663fe1cc-0269-4f82-844c-3bc39fd9df61 service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4f2a95d9-59dd-409b-8d31-c91dbfe00896 req-663fe1cc-0269-4f82-844c-3bc39fd9df61 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4f2a95d9-59dd-409b-8d31-c91dbfe00896 req-663fe1cc-0269-4f82-844c-3bc39fd9df61 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-4f2a95d9-59dd-409b-8d31-c91dbfe00896 req-663fe1cc-0269-4f82-844c-3bc39fd9df61 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:11 user nova-compute[71364]: WARNING nova.compute.manager [req-4f2a95d9-59dd-409b-8d31-c91dbfe00896 req-663fe1cc-0269-4f82-844c-3bc39fd9df61 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state active and task_state rebuild_spawning.
Apr 11 21:54:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "29e6c78a-dee0-4d28-86cd-debad15718d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:54:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:12 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:54:12 user nova-compute[71364]: INFO nova.compute.claims [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Claim successful on node user
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.network.neutron [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:54:13 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.policy [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:54:13 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Creating image(s)
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "/opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "/opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "/opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk 1073741824" returned: 0 in 0.053s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:13 user nova-compute[71364]: WARNING nova.compute.manager [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state active and task_state rebuild_spawning.
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Received event network-vif-plugged-2bd3732b-13bc-4017-891e-c808fd4d9b1f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Acquiring lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] No waiting events found dispatching network-vif-plugged-2bd3732b-13bc-4017-891e-c808fd4d9b1f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:13 user nova-compute[71364]: WARNING nova.compute.manager [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Received unexpected event network-vif-plugged-2bd3732b-13bc-4017-891e-c808fd4d9b1f for instance with vm_state building and task_state spawning.
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Received event network-vif-plugged-2bd3732b-13bc-4017-891e-c808fd4d9b1f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Acquiring lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] No waiting events found dispatching network-vif-plugged-2bd3732b-13bc-4017-891e-c808fd4d9b1f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:13 user nova-compute[71364]: WARNING nova.compute.manager [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Received unexpected event network-vif-plugged-2bd3732b-13bc-4017-891e-c808fd4d9b1f for instance with vm_state building and task_state spawning.
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.network.neutron [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Successfully created port: 2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Cannot resize image /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.objects.instance [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'migration_context' on Instance uuid 29e6c78a-dee0-4d28-86cd-debad15718d4 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Ensure instance console log exists: /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for 5ff9bbaf-1a5e-4acd-aca3-d956728312cb due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250054.148125, 5ff9bbaf-1a5e-4acd-aca3-d956728312cb => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:54:14 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] VM Resumed (Lifecycle Event)
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:54:14 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance spawned successfully.
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:14 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250054.1533535, 5ff9bbaf-1a5e-4acd-aca3-d956728312cb => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:54:14 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] VM Started (Lifecycle Event)
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:54:14 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71364) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.077s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250054.688071, d4aa732e-7598-443e-96f3-11e7f271e06d => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:54:14 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] VM Resumed (Lifecycle Event)
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:54:14 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Instance spawned successfully.
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:14 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250054.6896822, d4aa732e-7598-443e-96f3-11e7f271e06d => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:54:14 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] VM Started (Lifecycle Event)
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:54:14 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:54:14 user nova-compute[71364]: INFO nova.compute.manager [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Took 7.89 seconds to spawn the instance on the hypervisor.
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Successfully updated port: 2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquired lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:54:14 user nova-compute[71364]: INFO nova.compute.manager [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Took 8.79 seconds to build instance.
Apr 11 21:54:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:54:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "d4aa732e-7598-443e-96f3-11e7f271e06d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.907s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.network.neutron [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Updating instance_info_cache with network_info: [{"id": "2e074aaa-933c-4085-ad92-4699f1ac3975", "address": "fa:16:3e:8f:33:19", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e074aaa-93", "ovs_interfaceid": "2e074aaa-933c-4085-ad92-4699f1ac3975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Releasing lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Instance network_info: |[{"id": "2e074aaa-933c-4085-ad92-4699f1ac3975", "address": "fa:16:3e:8f:33:19", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e074aaa-93", "ovs_interfaceid": "2e074aaa-933c-4085-ad92-4699f1ac3975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Start _get_guest_xml network_info=[{"id": "2e074aaa-933c-4085-ad92-4699f1ac3975", "address": "fa:16:3e:8f:33:19", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e074aaa-93", "ovs_interfaceid": "2e074aaa-933c-4085-ad92-4699f1ac3975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:54:15 user nova-compute[71364]: INFO nova.compute.claims [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Claim successful on node user
Apr 11 21:54:15 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:54:15 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1886871260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1886871260',id=15,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53057a8fc17e400e8c26a7dec2c873f9',ramdisk_id='',reservation_id='r-6bs8od9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:54:13Z,user_data=None,user_id='10430313a8b44e6794ca88d30a83c69a',uuid=29e6c78a-dee0-4d28-86cd-debad15718d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e074aaa-933c-4085-ad92-4699f1ac3975", "address": "fa:16:3e:8f:33:19", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e074aaa-93", "ovs_interfaceid": "2e074aaa-933c-4085-ad92-4699f1ac3975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converting VIF {"id": "2e074aaa-933c-4085-ad92-4699f1ac3975", "address": "fa:16:3e:8f:33:19", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e074aaa-93", "ovs_interfaceid": "2e074aaa-933c-4085-ad92-4699f1ac3975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:33:19,bridge_name='br-int',has_traffic_filtering=True,id=2e074aaa-933c-4085-ad92-4699f1ac3975,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e074aaa-93') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.objects.instance [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'pci_devices' on Instance uuid 29e6c78a-dee0-4d28-86cd-debad15718d4 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:54:15 user nova-compute[71364]:   <uuid>29e6c78a-dee0-4d28-86cd-debad15718d4</uuid>
Apr 11 21:54:15 user nova-compute[71364]:   <name>instance-0000000f</name>
Apr 11 21:54:15 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:54:15 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:54:15 user nova-compute[71364]:   <metadata>
Apr 11 21:54:15 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:54:15 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:54:15 user nova-compute[71364]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1886871260</nova:name>
Apr 11 21:54:15 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:54:15</nova:creationTime>
Apr 11 21:54:15 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:54:15 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:54:15 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:54:15 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:54:15 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:54:15 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:54:15 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:54:15 user nova-compute[71364]:       <nova:owner>
Apr 11 21:54:15 user nova-compute[71364]:         <nova:user uuid="10430313a8b44e6794ca88d30a83c69a">tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member</nova:user>
Apr 11 21:54:15 user nova-compute[71364]:         <nova:project uuid="53057a8fc17e400e8c26a7dec2c873f9">tempest-ServerBootFromVolumeStableRescueTest-1235920472</nova:project>
Apr 11 21:54:15 user nova-compute[71364]:       </nova:owner>
Apr 11 21:54:15 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:54:15 user nova-compute[71364]:       <nova:ports>
Apr 11 21:54:15 user nova-compute[71364]:         <nova:port uuid="2e074aaa-933c-4085-ad92-4699f1ac3975">
Apr 11 21:54:15 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 21:54:15 user nova-compute[71364]:         </nova:port>
Apr 11 21:54:15 user nova-compute[71364]:       </nova:ports>
Apr 11 21:54:15 user nova-compute[71364]:     </nova:instance>
Apr 11 21:54:15 user nova-compute[71364]:   </metadata>
Apr 11 21:54:15 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:54:15 user nova-compute[71364]:     <system>
Apr 11 21:54:15 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:54:15 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:54:15 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:54:15 user nova-compute[71364]:       <entry name="serial">29e6c78a-dee0-4d28-86cd-debad15718d4</entry>
Apr 11 21:54:15 user nova-compute[71364]:       <entry name="uuid">29e6c78a-dee0-4d28-86cd-debad15718d4</entry>
Apr 11 21:54:15 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:54:15 user nova-compute[71364]:     </system>
Apr 11 21:54:15 user nova-compute[71364]:   </sysinfo>
Apr 11 21:54:15 user nova-compute[71364]:   <os>
Apr 11 21:54:15 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:54:15 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:54:15 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:54:15 user nova-compute[71364]:   </os>
Apr 11 21:54:15 user nova-compute[71364]:   <features>
Apr 11 21:54:15 user nova-compute[71364]:     <acpi/>
Apr 11 21:54:15 user nova-compute[71364]:     <apic/>
Apr 11 21:54:15 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:54:15 user nova-compute[71364]:   </features>
Apr 11 21:54:15 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:54:15 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:54:15 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:54:15 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:54:15 user nova-compute[71364]:   </clock>
Apr 11 21:54:15 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:54:15 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:54:15 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:54:15 user nova-compute[71364]:   </cpu>
Apr 11 21:54:15 user nova-compute[71364]:   <devices>
Apr 11 21:54:15 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:54:15 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:54:15 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk"/>
Apr 11 21:54:15 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:54:15 user nova-compute[71364]:     </disk>
Apr 11 21:54:15 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:54:15 user nova-compute[71364]:       <mac address="fa:16:3e:8f:33:19"/>
Apr 11 21:54:15 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:54:15 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:54:15 user nova-compute[71364]:       <target dev="tap2e074aaa-93"/>
Apr 11 21:54:15 user nova-compute[71364]:     </interface>
Apr 11 21:54:15 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:54:15 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/console.log" append="off"/>
Apr 11 21:54:15 user nova-compute[71364]:     </serial>
Apr 11 21:54:15 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:54:15 user nova-compute[71364]:     <video>
Apr 11 21:54:15 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:54:15 user nova-compute[71364]:     </video>
Apr 11 21:54:15 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:54:15 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:54:15 user nova-compute[71364]:     </rng>
Apr 11 21:54:15 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:54:15 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:54:15 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:54:15 user nova-compute[71364]:     </memballoon>
Apr 11 21:54:15 user nova-compute[71364]:   </devices>
Apr 11 21:54:15 user nova-compute[71364]: </domain>
Apr 11 21:54:15 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1886871260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1886871260',id=15,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53057a8fc17e400e8c26a7dec2c873f9',ramdisk_id='',reservation_id='r-6bs8od9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:54:13Z,user_data=None,user_id='10430313a8b44e6794ca88d30a83c69a',uuid=29e6c78a-dee0-4d28-86cd-debad15718d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e074aaa-933c-4085-ad92-4699f1ac3975", "address": "fa:16:3e:8f:33:19", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e074aaa-93", "ovs_interfaceid": "2e074aaa-933c-4085-ad92-4699f1ac3975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converting VIF {"id": "2e074aaa-933c-4085-ad92-4699f1ac3975", "address": "fa:16:3e:8f:33:19", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e074aaa-93", "ovs_interfaceid": "2e074aaa-933c-4085-ad92-4699f1ac3975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:33:19,bridge_name='br-int',has_traffic_filtering=True,id=2e074aaa-933c-4085-ad92-4699f1ac3975,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e074aaa-93') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG os_vif [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:33:19,bridge_name='br-int',has_traffic_filtering=True,id=2e074aaa-933c-4085-ad92-4699f1ac3975,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e074aaa-93') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e074aaa-93, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e074aaa-93, col_values=(('external_ids', {'iface-id': '2e074aaa-933c-4085-ad92-4699f1ac3975', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:33:19', 'vm-uuid': '29e6c78a-dee0-4d28-86cd-debad15718d4'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:15 user nova-compute[71364]: INFO os_vif [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:33:19,bridge_name='br-int',has_traffic_filtering=True,id=2e074aaa-933c-4085-ad92-4699f1ac3975,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e074aaa-93')
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] No VIF found with MAC fa:16:3e:8f:33:19, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-d71eb0ed-9b6b-4a31-99bd-70bebc798c7d req-cb0367e6-6df3-44a5-88ea-677e1777c0a2 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received event network-changed-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-d71eb0ed-9b6b-4a31-99bd-70bebc798c7d req-cb0367e6-6df3-44a5-88ea-677e1777c0a2 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Refreshing instance network info cache due to event network-changed-2e074aaa-933c-4085-ad92-4699f1ac3975. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d71eb0ed-9b6b-4a31-99bd-70bebc798c7d req-cb0367e6-6df3-44a5-88ea-677e1777c0a2 service nova] Acquiring lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d71eb0ed-9b6b-4a31-99bd-70bebc798c7d req-cb0367e6-6df3-44a5-88ea-677e1777c0a2 service nova] Acquired lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.network.neutron [req-d71eb0ed-9b6b-4a31-99bd-70bebc798c7d req-cb0367e6-6df3-44a5-88ea-677e1777c0a2 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Refreshing network info cache for port 2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:54:15 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:54:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:54:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:54:16 user nova-compute[71364]: DEBUG nova.network.neutron [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:54:16 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:54:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:54:16 user nova-compute[71364]: DEBUG nova.policy [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1aeabb5e8b4b463e8481e4ae8ecc1153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5d7d74644c8bb2f768e9a871f75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:54:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:54:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:54:16 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Creating image(s)
Apr 11 21:54:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "/opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "/opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "/opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "63fd026d7991e8cc7dab3f4a49c81d753eddf271" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "63fd026d7991e8cc7dab3f4a49c81d753eddf271" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271.part --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG nova.network.neutron [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Successfully created port: bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG nova.network.neutron [req-d71eb0ed-9b6b-4a31-99bd-70bebc798c7d req-cb0367e6-6df3-44a5-88ea-677e1777c0a2 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Updated VIF entry in instance network info cache for port 2e074aaa-933c-4085-ad92-4699f1ac3975. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG nova.network.neutron [req-d71eb0ed-9b6b-4a31-99bd-70bebc798c7d req-cb0367e6-6df3-44a5-88ea-677e1777c0a2 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Updating instance_info_cache with network_info: [{"id": "2e074aaa-933c-4085-ad92-4699f1ac3975", "address": "fa:16:3e:8f:33:19", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e074aaa-93", "ovs_interfaceid": "2e074aaa-933c-4085-ad92-4699f1ac3975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d71eb0ed-9b6b-4a31-99bd-70bebc798c7d req-cb0367e6-6df3-44a5-88ea-677e1777c0a2 service nova] Releasing lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271.part --force-share --output=json" returned: 0 in 0.213s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG nova.virt.images [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] be1b20e5-21d3-485f-9a0a-df2097538037 was qcow2, converting to raw {{(pid=71364) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271.part /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271.converted {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-040cce83-db1f-428a-bf7b-64239c0e1d23 req-ada9d44e-e38a-466f-9c43-5d2ec6d43c5a service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received event network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-040cce83-db1f-428a-bf7b-64239c0e1d23 req-ada9d44e-e38a-466f-9c43-5d2ec6d43c5a service nova] Acquiring lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-040cce83-db1f-428a-bf7b-64239c0e1d23 req-ada9d44e-e38a-466f-9c43-5d2ec6d43c5a service nova] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-040cce83-db1f-428a-bf7b-64239c0e1d23 req-ada9d44e-e38a-466f-9c43-5d2ec6d43c5a service nova] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-040cce83-db1f-428a-bf7b-64239c0e1d23 req-ada9d44e-e38a-466f-9c43-5d2ec6d43c5a service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] No waiting events found dispatching network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:17 user nova-compute[71364]: WARNING nova.compute.manager [req-040cce83-db1f-428a-bf7b-64239c0e1d23 req-ada9d44e-e38a-466f-9c43-5d2ec6d43c5a service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received unexpected event network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 for instance with vm_state building and task_state spawning.
Apr 11 21:54:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271.part /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271.converted" returned: 0 in 0.242s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271.converted --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "63fd026d7991e8cc7dab3f4a49c81d753eddf271" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.843s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271 --force-share --output=json" returned: 0 in 0.171s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "63fd026d7991e8cc7dab3f4a49c81d753eddf271" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "63fd026d7991e8cc7dab3f4a49c81d753eddf271" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271 --force-share --output=json" returned: 0 in 0.159s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271,backing_fmt=raw /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271,backing_fmt=raw /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk 1073741824" returned: 0 in 0.056s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "63fd026d7991e8cc7dab3f4a49c81d753eddf271" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG nova.network.neutron [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Successfully updated port: bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-6a6aeb4c-f00d-4d86-8179-522f89198074 req-0b814efc-3a5d-4263-ae77-897b9d4118a6 service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Received event network-changed-bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-6a6aeb4c-f00d-4d86-8179-522f89198074 req-0b814efc-3a5d-4263-ae77-897b9d4118a6 service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Refreshing instance network info cache due to event network-changed-bfd12cce-c416-4b40-a9f4-323c2de32995. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6a6aeb4c-f00d-4d86-8179-522f89198074 req-0b814efc-3a5d-4263-ae77-897b9d4118a6 service nova] Acquiring lock "refresh_cache-906866ce-6f86-4036-8b39-76b3e7d7c1fb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6a6aeb4c-f00d-4d86-8179-522f89198074 req-0b814efc-3a5d-4263-ae77-897b9d4118a6 service nova] Acquired lock "refresh_cache-906866ce-6f86-4036-8b39-76b3e7d7c1fb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG nova.network.neutron [req-6a6aeb4c-f00d-4d86-8179-522f89198074 req-0b814efc-3a5d-4263-ae77-897b9d4118a6 service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Refreshing network info cache for port bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "refresh_cache-906866ce-6f86-4036-8b39-76b3e7d7c1fb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271 --force-share --output=json" returned: 0 in 0.168s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG nova.objects.instance [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lazy-loading 'migration_context' on Instance uuid 906866ce-6f86-4036-8b39-76b3e7d7c1fb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG nova.network.neutron [req-6a6aeb4c-f00d-4d86-8179-522f89198074 req-0b814efc-3a5d-4263-ae77-897b9d4118a6 service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Ensure instance console log exists: /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:18 user nova-compute[71364]: DEBUG nova.network.neutron [req-6a6aeb4c-f00d-4d86-8179-522f89198074 req-0b814efc-3a5d-4263-ae77-897b9d4118a6 service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6a6aeb4c-f00d-4d86-8179-522f89198074 req-0b814efc-3a5d-4263-ae77-897b9d4118a6 service nova] Releasing lock "refresh_cache-906866ce-6f86-4036-8b39-76b3e7d7c1fb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquired lock "refresh_cache-906866ce-6f86-4036-8b39-76b3e7d7c1fb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Updating instance_info_cache with network_info: [{"id": "bfd12cce-c416-4b40-a9f4-323c2de32995", "address": "fa:16:3e:7f:95:3a", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd12cce-c4", "ovs_interfaceid": "bfd12cce-c416-4b40-a9f4-323c2de32995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Releasing lock "refresh_cache-906866ce-6f86-4036-8b39-76b3e7d7c1fb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Instance network_info: |[{"id": "bfd12cce-c416-4b40-a9f4-323c2de32995", "address": "fa:16:3e:7f:95:3a", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd12cce-c4", "ovs_interfaceid": "bfd12cce-c416-4b40-a9f4-323c2de32995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Start _get_guest_xml network_info=[{"id": "bfd12cce-c416-4b40-a9f4-323c2de32995", "address": "fa:16:3e:7f:95:3a", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd12cce-c4", "ovs_interfaceid": "bfd12cce-c416-4b40-a9f4-323c2de32995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='51d0e7f005569118d4c4905976a032b4',container_format='bare',created_at=2023-04-11T21:54:05Z,direct_url=<?>,disk_format='qcow2',id=be1b20e5-21d3-485f-9a0a-df2097538037,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1673605485',owner='b8df5d7d74644c8bb2f768e9a871f75c',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-11T21:54:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'be1b20e5-21d3-485f-9a0a-df2097538037'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:54:19 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:54:19 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='51d0e7f005569118d4c4905976a032b4',container_format='bare',created_at=2023-04-11T21:54:05Z,direct_url=<?>,disk_format='qcow2',id=be1b20e5-21d3-485f-9a0a-df2097538037,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1673605485',owner='b8df5d7d74644c8bb2f768e9a871f75c',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-11T21:54:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-87720805',display_name='tempest-TestStampPattern-server-87720805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-87720805',id=16,image_ref='be1b20e5-21d3-485f-9a0a-df2097538037',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpCRhqzUB7FAJyPBKJlCQG79NsEN1MlKiYeS6HxcdWPP0UKr1248UxMjqeqQ05u0XR5/7y/57d+iYThyqW9HhypiFf/4Et50oE3GriCFvwstOcaJA+DGlCD4+QUkbFCBA==',key_name='tempest-TestStampPattern-1506752109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8df5d7d74644c8bb2f768e9a871f75c',ramdisk_id='',reservation_id='r-3cc0e0t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='76315af2-c4b9-4ad5-98ea-81826524d63e',image_min_disk='1',image_min_ram='0',image_owner_id='b8df5d7d74644c8bb2f768e9a871f75c',image_owner_project_name='tempest-TestStampPattern-1188732380',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1188732380-project-member',image_user_id='1aeabb5e8b4b463e8481e4ae8ecc1153',network_allocated='True',owner_project_name='tempest-TestStampPattern-1188732380',owner_user_name='tempest-TestStampPattern-1188732380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:54:16Z,user_data=None,user_id='1aeabb5e8b4b463e8481e4ae8ecc1153',uuid=906866ce-6f86-4036-8b39-76b3e7d7c1fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfd12cce-c416-4b40-a9f4-323c2de32995", "address": "fa:16:3e:7f:95:3a", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd12cce-c4", "ovs_interfaceid": "bfd12cce-c416-4b40-a9f4-323c2de32995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Converting VIF {"id": "bfd12cce-c416-4b40-a9f4-323c2de32995", "address": "fa:16:3e:7f:95:3a", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd12cce-c4", "ovs_interfaceid": "bfd12cce-c416-4b40-a9f4-323c2de32995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:95:3a,bridge_name='br-int',has_traffic_filtering=True,id=bfd12cce-c416-4b40-a9f4-323c2de32995,network=Network(ba787967-1d37-4f5f-8a91-3e720641c16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd12cce-c4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.objects.instance [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lazy-loading 'pci_devices' on Instance uuid 906866ce-6f86-4036-8b39-76b3e7d7c1fb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:54:19 user nova-compute[71364]:   <uuid>906866ce-6f86-4036-8b39-76b3e7d7c1fb</uuid>
Apr 11 21:54:19 user nova-compute[71364]:   <name>instance-00000010</name>
Apr 11 21:54:19 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:54:19 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:54:19 user nova-compute[71364]:   <metadata>
Apr 11 21:54:19 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:54:19 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:54:19 user nova-compute[71364]:       <nova:name>tempest-TestStampPattern-server-87720805</nova:name>
Apr 11 21:54:19 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:54:19</nova:creationTime>
Apr 11 21:54:19 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:54:19 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:54:19 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:54:19 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:54:19 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:54:19 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:54:19 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:54:19 user nova-compute[71364]:       <nova:owner>
Apr 11 21:54:19 user nova-compute[71364]:         <nova:user uuid="1aeabb5e8b4b463e8481e4ae8ecc1153">tempest-TestStampPattern-1188732380-project-member</nova:user>
Apr 11 21:54:19 user nova-compute[71364]:         <nova:project uuid="b8df5d7d74644c8bb2f768e9a871f75c">tempest-TestStampPattern-1188732380</nova:project>
Apr 11 21:54:19 user nova-compute[71364]:       </nova:owner>
Apr 11 21:54:19 user nova-compute[71364]:       <nova:root type="image" uuid="be1b20e5-21d3-485f-9a0a-df2097538037"/>
Apr 11 21:54:19 user nova-compute[71364]:       <nova:ports>
Apr 11 21:54:19 user nova-compute[71364]:         <nova:port uuid="bfd12cce-c416-4b40-a9f4-323c2de32995">
Apr 11 21:54:19 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 21:54:19 user nova-compute[71364]:         </nova:port>
Apr 11 21:54:19 user nova-compute[71364]:       </nova:ports>
Apr 11 21:54:19 user nova-compute[71364]:     </nova:instance>
Apr 11 21:54:19 user nova-compute[71364]:   </metadata>
Apr 11 21:54:19 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:54:19 user nova-compute[71364]:     <system>
Apr 11 21:54:19 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:54:19 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:54:19 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:54:19 user nova-compute[71364]:       <entry name="serial">906866ce-6f86-4036-8b39-76b3e7d7c1fb</entry>
Apr 11 21:54:19 user nova-compute[71364]:       <entry name="uuid">906866ce-6f86-4036-8b39-76b3e7d7c1fb</entry>
Apr 11 21:54:19 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:54:19 user nova-compute[71364]:     </system>
Apr 11 21:54:19 user nova-compute[71364]:   </sysinfo>
Apr 11 21:54:19 user nova-compute[71364]:   <os>
Apr 11 21:54:19 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:54:19 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:54:19 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:54:19 user nova-compute[71364]:   </os>
Apr 11 21:54:19 user nova-compute[71364]:   <features>
Apr 11 21:54:19 user nova-compute[71364]:     <acpi/>
Apr 11 21:54:19 user nova-compute[71364]:     <apic/>
Apr 11 21:54:19 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:54:19 user nova-compute[71364]:   </features>
Apr 11 21:54:19 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:54:19 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:54:19 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:54:19 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:54:19 user nova-compute[71364]:   </clock>
Apr 11 21:54:19 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:54:19 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:54:19 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:54:19 user nova-compute[71364]:   </cpu>
Apr 11 21:54:19 user nova-compute[71364]:   <devices>
Apr 11 21:54:19 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:54:19 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:54:19 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk"/>
Apr 11 21:54:19 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:54:19 user nova-compute[71364]:     </disk>
Apr 11 21:54:19 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:54:19 user nova-compute[71364]:       <mac address="fa:16:3e:7f:95:3a"/>
Apr 11 21:54:19 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:54:19 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:54:19 user nova-compute[71364]:       <target dev="tapbfd12cce-c4"/>
Apr 11 21:54:19 user nova-compute[71364]:     </interface>
Apr 11 21:54:19 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:54:19 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/console.log" append="off"/>
Apr 11 21:54:19 user nova-compute[71364]:     </serial>
Apr 11 21:54:19 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:54:19 user nova-compute[71364]:     <video>
Apr 11 21:54:19 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:54:19 user nova-compute[71364]:     </video>
Apr 11 21:54:19 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:54:19 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:54:19 user nova-compute[71364]:     </rng>
Apr 11 21:54:19 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:54:19 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:54:19 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:54:19 user nova-compute[71364]:     </memballoon>
Apr 11 21:54:19 user nova-compute[71364]:   </devices>
Apr 11 21:54:19 user nova-compute[71364]: </domain>
Apr 11 21:54:19 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-87720805',display_name='tempest-TestStampPattern-server-87720805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-87720805',id=16,image_ref='be1b20e5-21d3-485f-9a0a-df2097538037',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpCRhqzUB7FAJyPBKJlCQG79NsEN1MlKiYeS6HxcdWPP0UKr1248UxMjqeqQ05u0XR5/7y/57d+iYThyqW9HhypiFf/4Et50oE3GriCFvwstOcaJA+DGlCD4+QUkbFCBA==',key_name='tempest-TestStampPattern-1506752109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8df5d7d74644c8bb2f768e9a871f75c',ramdisk_id='',reservation_id='r-3cc0e0t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='76315af2-c4b9-4ad5-98ea-81826524d63e',image_min_disk='1',image_min_ram='0',image_owner_id='b8df5d7d74644c8bb2f768e9a871f75c',image_owner_project_name='tempest-TestStampPattern-1188732380',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1188732380-project-member',image_user_id='1aeabb5e8b4b463e8481e4ae8ecc1153',network_allocated='True',owner_project_name='tempest-TestStampPattern-1188732380',owner_user_name='tempest-TestStampPattern-1188732380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:54:16Z,user_data=None,user_id='1aeabb5e8b4b463e8481e4ae8ecc1153',uuid=906866ce-6f86-4036-8b39-76b3e7d7c1fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfd12cce-c416-4b40-a9f4-323c2de32995", "address": "fa:16:3e:7f:95:3a", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd12cce-c4", "ovs_interfaceid": "bfd12cce-c416-4b40-a9f4-323c2de32995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Converting VIF {"id": "bfd12cce-c416-4b40-a9f4-323c2de32995", "address": "fa:16:3e:7f:95:3a", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd12cce-c4", "ovs_interfaceid": "bfd12cce-c416-4b40-a9f4-323c2de32995", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:95:3a,bridge_name='br-int',has_traffic_filtering=True,id=bfd12cce-c416-4b40-a9f4-323c2de32995,network=Network(ba787967-1d37-4f5f-8a91-3e720641c16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd12cce-c4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG os_vif [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:95:3a,bridge_name='br-int',has_traffic_filtering=True,id=bfd12cce-c416-4b40-a9f4-323c2de32995,network=Network(ba787967-1d37-4f5f-8a91-3e720641c16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd12cce-c4') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfd12cce-c4, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbfd12cce-c4, col_values=(('external_ids', {'iface-id': 'bfd12cce-c416-4b40-a9f4-323c2de32995', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:95:3a', 'vm-uuid': '906866ce-6f86-4036-8b39-76b3e7d7c1fb'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:19 user nova-compute[71364]: INFO os_vif [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:95:3a,bridge_name='br-int',has_traffic_filtering=True,id=bfd12cce-c416-4b40-a9f4-323c2de32995,network=Network(ba787967-1d37-4f5f-8a91-3e720641c16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd12cce-c4')
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] No VIF found with MAC fa:16:3e:7f:95:3a, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250059.9921343, 29e6c78a-dee0-4d28-86cd-debad15718d4 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:54:19 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] VM Resumed (Lifecycle Event)
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:54:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-6f4192e9-63fe-46cc-8cbf-173ba77b6d0d req-57d534d5-b544-4503-82b0-2599c7d24789 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received event network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6f4192e9-63fe-46cc-8cbf-173ba77b6d0d req-57d534d5-b544-4503-82b0-2599c7d24789 service nova] Acquiring lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6f4192e9-63fe-46cc-8cbf-173ba77b6d0d req-57d534d5-b544-4503-82b0-2599c7d24789 service nova] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6f4192e9-63fe-46cc-8cbf-173ba77b6d0d req-57d534d5-b544-4503-82b0-2599c7d24789 service nova] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-6f4192e9-63fe-46cc-8cbf-173ba77b6d0d req-57d534d5-b544-4503-82b0-2599c7d24789 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] No waiting events found dispatching network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:20 user nova-compute[71364]: WARNING nova.compute.manager [req-6f4192e9-63fe-46cc-8cbf-173ba77b6d0d req-57d534d5-b544-4503-82b0-2599c7d24789 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received unexpected event network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 for instance with vm_state building and task_state spawning.
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:20 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Instance spawned successfully.
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:20 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250059.9945855, 29e6c78a-dee0-4d28-86cd-debad15718d4 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:54:20 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] VM Started (Lifecycle Event)
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:54:20 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:54:20 user nova-compute[71364]: INFO nova.compute.manager [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Took 6.86 seconds to spawn the instance on the hypervisor.
Apr 11 21:54:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:20 user nova-compute[71364]: INFO nova.compute.manager [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Took 7.61 seconds to build instance.
Apr 11 21:54:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.828s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:21 user nova-compute[71364]: DEBUG nova.compute.manager [req-2658c9d6-07cf-4797-8ceb-baa668c8337f req-37183030-291d-4bf7-a67b-700182e0b87c service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Received event network-vif-plugged-bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2658c9d6-07cf-4797-8ceb-baa668c8337f req-37183030-291d-4bf7-a67b-700182e0b87c service nova] Acquiring lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2658c9d6-07cf-4797-8ceb-baa668c8337f req-37183030-291d-4bf7-a67b-700182e0b87c service nova] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2658c9d6-07cf-4797-8ceb-baa668c8337f req-37183030-291d-4bf7-a67b-700182e0b87c service nova] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:21 user nova-compute[71364]: DEBUG nova.compute.manager [req-2658c9d6-07cf-4797-8ceb-baa668c8337f req-37183030-291d-4bf7-a67b-700182e0b87c service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] No waiting events found dispatching network-vif-plugged-bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:21 user nova-compute[71364]: WARNING nova.compute.manager [req-2658c9d6-07cf-4797-8ceb-baa668c8337f req-37183030-291d-4bf7-a67b-700182e0b87c service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Received unexpected event network-vif-plugged-bfd12cce-c416-4b40-a9f4-323c2de32995 for instance with vm_state building and task_state spawning.
Apr 11 21:54:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0611c3e0-b062-41af-832c-b358f7630ab4 req-73b2ab01-147b-4ba0-bd49-7a5f36ea538d service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Received event network-vif-plugged-bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0611c3e0-b062-41af-832c-b358f7630ab4 req-73b2ab01-147b-4ba0-bd49-7a5f36ea538d service nova] Acquiring lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0611c3e0-b062-41af-832c-b358f7630ab4 req-73b2ab01-147b-4ba0-bd49-7a5f36ea538d service nova] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0611c3e0-b062-41af-832c-b358f7630ab4 req-73b2ab01-147b-4ba0-bd49-7a5f36ea538d service nova] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0611c3e0-b062-41af-832c-b358f7630ab4 req-73b2ab01-147b-4ba0-bd49-7a5f36ea538d service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] No waiting events found dispatching network-vif-plugged-bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:23 user nova-compute[71364]: WARNING nova.compute.manager [req-0611c3e0-b062-41af-832c-b358f7630ab4 req-73b2ab01-147b-4ba0-bd49-7a5f36ea538d service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Received unexpected event network-vif-plugged-bfd12cce-c416-4b40-a9f4-323c2de32995 for instance with vm_state building and task_state spawning.
Apr 11 21:54:24 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250064.04552, 906866ce-6f86-4036-8b39-76b3e7d7c1fb => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:54:24 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] VM Resumed (Lifecycle Event)
Apr 11 21:54:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:54:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:54:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:24 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Instance spawned successfully.
Apr 11 21:54:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:54:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:54:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:24 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:54:24 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250064.0476665, 906866ce-6f86-4036-8b39-76b3e7d7c1fb => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:54:24 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] VM Started (Lifecycle Event)
Apr 11 21:54:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:54:24 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:54:24 user nova-compute[71364]: INFO nova.compute.manager [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Took 7.91 seconds to spawn the instance on the hypervisor.
Apr 11 21:54:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:24 user nova-compute[71364]: INFO nova.compute.manager [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Took 8.90 seconds to build instance.
Apr 11 21:54:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.003s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:35 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:54:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:54:36 user nova-compute[71364]: INFO nova.compute.claims [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Claim successful on node user
Apr 11 21:54:36 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:54:36 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:54:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:54:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:54:36 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:54:36 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:54:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:54:36 user nova-compute[71364]: DEBUG nova.policy [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:54:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:54:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:54:36 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Creating image(s)
Apr 11 21:54:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "/opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "/opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "/opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.249s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:54:37 user nova-compute[71364]: INFO nova.compute.claims [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Claim successful on node user
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk 1073741824" returned: 0 in 0.059s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Successfully created port: 809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.156s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Cannot resize image /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'migration_context' on Instance uuid b66951a9-73f3-41ce-9f19-b4e5e24d61b0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Ensure instance console log exists: /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:54:37 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.policy [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:54:37 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Creating image(s)
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "/opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "/opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "/opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.155s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk 1073741824" returned: 0 in 0.047s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.156s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Successfully created port: 03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Cannot resize image /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'migration_context' on Instance uuid 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Ensure instance console log exists: /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Successfully updated port: 809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquired lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG nova.compute.manager [req-853d6457-f59a-4688-b3e0-6065e4dd956a req-b201da5b-892f-4ea1-90bb-4cdc9cc79857 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-changed-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG nova.compute.manager [req-853d6457-f59a-4688-b3e0-6065e4dd956a req-b201da5b-892f-4ea1-90bb-4cdc9cc79857 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Refreshing instance network info cache due to event network-changed-809749e4-0885-4825-8976-660b2c0bcca7. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:54:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-853d6457-f59a-4688-b3e0-6065e4dd956a req-b201da5b-892f-4ea1-90bb-4cdc9cc79857 service nova] Acquiring lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Successfully updated port: 03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquired lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.compute.manager [req-3b20c951-f39a-4f22-9f61-3bef0a179872 req-7d489838-0c33-4dd6-ad35-e7db9187f59d service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received event network-changed-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.compute.manager [req-3b20c951-f39a-4f22-9f61-3bef0a179872 req-7d489838-0c33-4dd6-ad35-e7db9187f59d service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Refreshing instance network info cache due to event network-changed-03ff224c-ce46-4e9a-8eae-357d41acfef2. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3b20c951-f39a-4f22-9f61-3bef0a179872 req-7d489838-0c33-4dd6-ad35-e7db9187f59d service nova] Acquiring lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Updating instance_info_cache with network_info: [{"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Releasing lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Instance network_info: |[{"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-853d6457-f59a-4688-b3e0-6065e4dd956a req-b201da5b-892f-4ea1-90bb-4cdc9cc79857 service nova] Acquired lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.neutron [req-853d6457-f59a-4688-b3e0-6065e4dd956a req-b201da5b-892f-4ea1-90bb-4cdc9cc79857 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Refreshing network info cache for port 809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Start _get_guest_xml network_info=[{"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:54:39 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:54:39 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1390553747',display_name='tempest-ServerRescueNegativeTestJSON-server-1390553747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1390553747',id=17,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c35707743988462887127e06825cd483',ramdisk_id='',reservation_id='r-taxw1lk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-797099247',owner_user_name='tempest-ServerRescueNegativeTestJSON-797099247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:54:37Z,user_data=None,user_id='546f0a94a2ad450ead596252c786839e',uuid=b66951a9-73f3-41ce-9f19-b4e5e24d61b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converting VIF {"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:7c:1e,bridge_name='br-int',has_traffic_filtering=True,id=809749e4-0885-4825-8976-660b2c0bcca7,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809749e4-08') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'pci_devices' on Instance uuid b66951a9-73f3-41ce-9f19-b4e5e24d61b0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:54:39 user nova-compute[71364]:   <uuid>b66951a9-73f3-41ce-9f19-b4e5e24d61b0</uuid>
Apr 11 21:54:39 user nova-compute[71364]:   <name>instance-00000011</name>
Apr 11 21:54:39 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:54:39 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:54:39 user nova-compute[71364]:   <metadata>
Apr 11 21:54:39 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:54:39 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:54:39 user nova-compute[71364]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1390553747</nova:name>
Apr 11 21:54:39 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:54:39</nova:creationTime>
Apr 11 21:54:39 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:54:39 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:54:39 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:54:39 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:54:39 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:54:39 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:54:39 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:54:39 user nova-compute[71364]:       <nova:owner>
Apr 11 21:54:39 user nova-compute[71364]:         <nova:user uuid="546f0a94a2ad450ead596252c786839e">tempest-ServerRescueNegativeTestJSON-797099247-project-member</nova:user>
Apr 11 21:54:39 user nova-compute[71364]:         <nova:project uuid="c35707743988462887127e06825cd483">tempest-ServerRescueNegativeTestJSON-797099247</nova:project>
Apr 11 21:54:39 user nova-compute[71364]:       </nova:owner>
Apr 11 21:54:39 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:54:39 user nova-compute[71364]:       <nova:ports>
Apr 11 21:54:39 user nova-compute[71364]:         <nova:port uuid="809749e4-0885-4825-8976-660b2c0bcca7">
Apr 11 21:54:39 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 21:54:39 user nova-compute[71364]:         </nova:port>
Apr 11 21:54:39 user nova-compute[71364]:       </nova:ports>
Apr 11 21:54:39 user nova-compute[71364]:     </nova:instance>
Apr 11 21:54:39 user nova-compute[71364]:   </metadata>
Apr 11 21:54:39 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:54:39 user nova-compute[71364]:     <system>
Apr 11 21:54:39 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:54:39 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:54:39 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:54:39 user nova-compute[71364]:       <entry name="serial">b66951a9-73f3-41ce-9f19-b4e5e24d61b0</entry>
Apr 11 21:54:39 user nova-compute[71364]:       <entry name="uuid">b66951a9-73f3-41ce-9f19-b4e5e24d61b0</entry>
Apr 11 21:54:39 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:54:39 user nova-compute[71364]:     </system>
Apr 11 21:54:39 user nova-compute[71364]:   </sysinfo>
Apr 11 21:54:39 user nova-compute[71364]:   <os>
Apr 11 21:54:39 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:54:39 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:54:39 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:54:39 user nova-compute[71364]:   </os>
Apr 11 21:54:39 user nova-compute[71364]:   <features>
Apr 11 21:54:39 user nova-compute[71364]:     <acpi/>
Apr 11 21:54:39 user nova-compute[71364]:     <apic/>
Apr 11 21:54:39 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:54:39 user nova-compute[71364]:   </features>
Apr 11 21:54:39 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:54:39 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:54:39 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:54:39 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:54:39 user nova-compute[71364]:   </clock>
Apr 11 21:54:39 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:54:39 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:54:39 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:54:39 user nova-compute[71364]:   </cpu>
Apr 11 21:54:39 user nova-compute[71364]:   <devices>
Apr 11 21:54:39 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:54:39 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:54:39 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk"/>
Apr 11 21:54:39 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:54:39 user nova-compute[71364]:     </disk>
Apr 11 21:54:39 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:54:39 user nova-compute[71364]:       <mac address="fa:16:3e:4a:7c:1e"/>
Apr 11 21:54:39 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:54:39 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:54:39 user nova-compute[71364]:       <target dev="tap809749e4-08"/>
Apr 11 21:54:39 user nova-compute[71364]:     </interface>
Apr 11 21:54:39 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:54:39 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/console.log" append="off"/>
Apr 11 21:54:39 user nova-compute[71364]:     </serial>
Apr 11 21:54:39 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:54:39 user nova-compute[71364]:     <video>
Apr 11 21:54:39 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:54:39 user nova-compute[71364]:     </video>
Apr 11 21:54:39 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:54:39 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:54:39 user nova-compute[71364]:     </rng>
Apr 11 21:54:39 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:54:39 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:54:39 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:54:39 user nova-compute[71364]:     </memballoon>
Apr 11 21:54:39 user nova-compute[71364]:   </devices>
Apr 11 21:54:39 user nova-compute[71364]: </domain>
Apr 11 21:54:39 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1390553747',display_name='tempest-ServerRescueNegativeTestJSON-server-1390553747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1390553747',id=17,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c35707743988462887127e06825cd483',ramdisk_id='',reservation_id='r-taxw1lk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-797099247',owner_user_name='tempest-ServerRescueNegativeTestJSON-797099247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:54:37Z,user_data=None,user_id='546f0a94a2ad450ead596252c786839e',uuid=b66951a9-73f3-41ce-9f19-b4e5e24d61b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converting VIF {"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:7c:1e,bridge_name='br-int',has_traffic_filtering=True,id=809749e4-0885-4825-8976-660b2c0bcca7,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809749e4-08') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG os_vif [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:7c:1e,bridge_name='br-int',has_traffic_filtering=True,id=809749e4-0885-4825-8976-660b2c0bcca7,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809749e4-08') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap809749e4-08, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap809749e4-08, col_values=(('external_ids', {'iface-id': '809749e4-0885-4825-8976-660b2c0bcca7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:7c:1e', 'vm-uuid': 'b66951a9-73f3-41ce-9f19-b4e5e24d61b0'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:39 user nova-compute[71364]: INFO os_vif [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:7c:1e,bridge_name='br-int',has_traffic_filtering=True,id=809749e4-0885-4825-8976-660b2c0bcca7,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809749e4-08')
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Updating instance_info_cache with network_info: [{"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Releasing lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Instance network_info: |[{"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3b20c951-f39a-4f22-9f61-3bef0a179872 req-7d489838-0c33-4dd6-ad35-e7db9187f59d service nova] Acquired lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.neutron [req-3b20c951-f39a-4f22-9f61-3bef0a179872 req-7d489838-0c33-4dd6-ad35-e7db9187f59d service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Refreshing network info cache for port 03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Start _get_guest_xml network_info=[{"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:54:39 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:54:39 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1993933386',display_name='tempest-ServerRescueNegativeTestJSON-server-1993933386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1993933386',id=18,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c35707743988462887127e06825cd483',ramdisk_id='',reservation_id='r-05vqbj4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-797099247',owner_user_name='tempest-ServerRescueNegativeTestJSON-797099247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:54:38Z,user_data=None,user_id='546f0a94a2ad450ead596252c786839e',uuid=76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converting VIF {"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=03ff224c-ce46-4e9a-8eae-357d41acfef2,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ff224c-ce') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'pci_devices' on Instance uuid 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:54:39 user nova-compute[71364]:   <uuid>76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d</uuid>
Apr 11 21:54:39 user nova-compute[71364]:   <name>instance-00000012</name>
Apr 11 21:54:39 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:54:39 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:54:39 user nova-compute[71364]:   <metadata>
Apr 11 21:54:39 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:54:39 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:54:39 user nova-compute[71364]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1993933386</nova:name>
Apr 11 21:54:39 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:54:39</nova:creationTime>
Apr 11 21:54:39 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:54:39 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:54:39 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:54:39 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:54:39 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:54:39 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:54:39 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:54:39 user nova-compute[71364]:       <nova:owner>
Apr 11 21:54:39 user nova-compute[71364]:         <nova:user uuid="546f0a94a2ad450ead596252c786839e">tempest-ServerRescueNegativeTestJSON-797099247-project-member</nova:user>
Apr 11 21:54:39 user nova-compute[71364]:         <nova:project uuid="c35707743988462887127e06825cd483">tempest-ServerRescueNegativeTestJSON-797099247</nova:project>
Apr 11 21:54:39 user nova-compute[71364]:       </nova:owner>
Apr 11 21:54:39 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:54:39 user nova-compute[71364]:       <nova:ports>
Apr 11 21:54:39 user nova-compute[71364]:         <nova:port uuid="03ff224c-ce46-4e9a-8eae-357d41acfef2">
Apr 11 21:54:39 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 21:54:39 user nova-compute[71364]:         </nova:port>
Apr 11 21:54:39 user nova-compute[71364]:       </nova:ports>
Apr 11 21:54:39 user nova-compute[71364]:     </nova:instance>
Apr 11 21:54:39 user nova-compute[71364]:   </metadata>
Apr 11 21:54:39 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:54:39 user nova-compute[71364]:     <system>
Apr 11 21:54:39 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:54:39 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:54:39 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:54:39 user nova-compute[71364]:       <entry name="serial">76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d</entry>
Apr 11 21:54:39 user nova-compute[71364]:       <entry name="uuid">76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d</entry>
Apr 11 21:54:39 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:54:39 user nova-compute[71364]:     </system>
Apr 11 21:54:39 user nova-compute[71364]:   </sysinfo>
Apr 11 21:54:39 user nova-compute[71364]:   <os>
Apr 11 21:54:39 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:54:39 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:54:39 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:54:39 user nova-compute[71364]:   </os>
Apr 11 21:54:39 user nova-compute[71364]:   <features>
Apr 11 21:54:39 user nova-compute[71364]:     <acpi/>
Apr 11 21:54:39 user nova-compute[71364]:     <apic/>
Apr 11 21:54:39 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:54:39 user nova-compute[71364]:   </features>
Apr 11 21:54:39 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:54:39 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:54:39 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:54:39 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:54:39 user nova-compute[71364]:   </clock>
Apr 11 21:54:39 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:54:39 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:54:39 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:54:39 user nova-compute[71364]:   </cpu>
Apr 11 21:54:39 user nova-compute[71364]:   <devices>
Apr 11 21:54:39 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:54:39 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:54:39 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk"/>
Apr 11 21:54:39 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:54:39 user nova-compute[71364]:     </disk>
Apr 11 21:54:39 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:54:39 user nova-compute[71364]:       <mac address="fa:16:3e:d3:96:ef"/>
Apr 11 21:54:39 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:54:39 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:54:39 user nova-compute[71364]:       <target dev="tap03ff224c-ce"/>
Apr 11 21:54:39 user nova-compute[71364]:     </interface>
Apr 11 21:54:39 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:54:39 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/console.log" append="off"/>
Apr 11 21:54:39 user nova-compute[71364]:     </serial>
Apr 11 21:54:39 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:54:39 user nova-compute[71364]:     <video>
Apr 11 21:54:39 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:54:39 user nova-compute[71364]:     </video>
Apr 11 21:54:39 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:54:39 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:54:39 user nova-compute[71364]:     </rng>
Apr 11 21:54:39 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:54:39 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:54:39 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:54:39 user nova-compute[71364]:     </memballoon>
Apr 11 21:54:39 user nova-compute[71364]:   </devices>
Apr 11 21:54:39 user nova-compute[71364]: </domain>
Apr 11 21:54:39 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1993933386',display_name='tempest-ServerRescueNegativeTestJSON-server-1993933386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1993933386',id=18,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c35707743988462887127e06825cd483',ramdisk_id='',reservation_id='r-05vqbj4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-797099247',owner_user_name='tempest-ServerRescueNegativeTestJSON-797099247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:54:38Z,user_data=None,user_id='546f0a94a2ad450ead596252c786839e',uuid=76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converting VIF {"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=03ff224c-ce46-4e9a-8eae-357d41acfef2,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ff224c-ce') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG os_vif [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=03ff224c-ce46-4e9a-8eae-357d41acfef2,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ff224c-ce') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03ff224c-ce, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap03ff224c-ce, col_values=(('external_ids', {'iface-id': '03ff224c-ce46-4e9a-8eae-357d41acfef2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:96:ef', 'vm-uuid': '76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No VIF found with MAC fa:16:3e:4a:7c:1e, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:39 user nova-compute[71364]: INFO os_vif [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=03ff224c-ce46-4e9a-8eae-357d41acfef2,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ff224c-ce')
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:54:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No VIF found with MAC fa:16:3e:d3:96:ef, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:54:40 user nova-compute[71364]: DEBUG nova.network.neutron [req-853d6457-f59a-4688-b3e0-6065e4dd956a req-b201da5b-892f-4ea1-90bb-4cdc9cc79857 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Updated VIF entry in instance network info cache for port 809749e4-0885-4825-8976-660b2c0bcca7. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:54:40 user nova-compute[71364]: DEBUG nova.network.neutron [req-853d6457-f59a-4688-b3e0-6065e4dd956a req-b201da5b-892f-4ea1-90bb-4cdc9cc79857 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Updating instance_info_cache with network_info: [{"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:54:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-853d6457-f59a-4688-b3e0-6065e4dd956a req-b201da5b-892f-4ea1-90bb-4cdc9cc79857 service nova] Releasing lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:54:40 user nova-compute[71364]: DEBUG nova.network.neutron [req-3b20c951-f39a-4f22-9f61-3bef0a179872 req-7d489838-0c33-4dd6-ad35-e7db9187f59d service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Updated VIF entry in instance network info cache for port 03ff224c-ce46-4e9a-8eae-357d41acfef2. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:54:40 user nova-compute[71364]: DEBUG nova.network.neutron [req-3b20c951-f39a-4f22-9f61-3bef0a179872 req-7d489838-0c33-4dd6-ad35-e7db9187f59d service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Updating instance_info_cache with network_info: [{"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:54:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3b20c951-f39a-4f22-9f61-3bef0a179872 req-7d489838-0c33-4dd6-ad35-e7db9187f59d service nova] Releasing lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:54:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-4a9831be-ad4e-42ef-b6e0-d6a967294d96 req-dd722471-8339-4dc8-b5c6-73c54d5c17d7 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received event network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a9831be-ad4e-42ef-b6e0-d6a967294d96 req-dd722471-8339-4dc8-b5c6-73c54d5c17d7 service nova] Acquiring lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a9831be-ad4e-42ef-b6e0-d6a967294d96 req-dd722471-8339-4dc8-b5c6-73c54d5c17d7 service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a9831be-ad4e-42ef-b6e0-d6a967294d96 req-dd722471-8339-4dc8-b5c6-73c54d5c17d7 service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-4a9831be-ad4e-42ef-b6e0-d6a967294d96 req-dd722471-8339-4dc8-b5c6-73c54d5c17d7 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] No waiting events found dispatching network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:42 user nova-compute[71364]: WARNING nova.compute.manager [req-4a9831be-ad4e-42ef-b6e0-d6a967294d96 req-dd722471-8339-4dc8-b5c6-73c54d5c17d7 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received unexpected event network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance with vm_state building and task_state spawning.
Apr 11 21:54:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received event network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Acquiring lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] No waiting events found dispatching network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:44 user nova-compute[71364]: WARNING nova.compute.manager [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received unexpected event network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance with vm_state building and task_state spawning.
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] No waiting events found dispatching network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:44 user nova-compute[71364]: WARNING nova.compute.manager [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received unexpected event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 for instance with vm_state building and task_state spawning.
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] No waiting events found dispatching network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:54:44 user nova-compute[71364]: WARNING nova.compute.manager [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received unexpected event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 for instance with vm_state building and task_state spawning.
Apr 11 21:54:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250084.917421, 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:54:44 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] VM Resumed (Lifecycle Event)
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:54:44 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Instance spawned successfully.
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:44 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Instance spawned successfully.
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:54:44 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:54:44 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250084.9189446, 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:54:44 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] VM Started (Lifecycle Event)
Apr 11 21:54:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:54:45 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:54:45 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250084.9276364, b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:54:45 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] VM Resumed (Lifecycle Event)
Apr 11 21:54:45 user nova-compute[71364]: INFO nova.compute.manager [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Took 8.25 seconds to spawn the instance on the hypervisor.
Apr 11 21:54:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:45 user nova-compute[71364]: INFO nova.compute.manager [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Took 7.11 seconds to spawn the instance on the hypervisor.
Apr 11 21:54:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:54:45 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:54:45 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250084.9294646, b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:54:45 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] VM Started (Lifecycle Event)
Apr 11 21:54:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:54:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:54:45 user nova-compute[71364]: INFO nova.compute.manager [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Took 9.10 seconds to build instance.
Apr 11 21:54:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.188s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:45 user nova-compute[71364]: INFO nova.compute.manager [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Took 8.08 seconds to build instance.
Apr 11 21:54:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.188s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:50 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-71a04a77-49b8-4d4a-bc66-e233aa7eab08" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-71a04a77-49b8-4d4a-bc66-e233aa7eab08" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Updating instance_info_cache with network_info: [{"id": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "address": "fa:16:3e:c2:69:1f", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7ba51-43", "ovs_interfaceid": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-71a04a77-49b8-4d4a-bc66-e233aa7eab08" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:54:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:54:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:54:56 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:54:56 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7148MB free_disk=26.245250701904297GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance e627de16-3a8f-4510-8001-0e57a272b859 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76315af2-c4b9-4ad5-98ea-81826524d63e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d4aa732e-7598-443e-96f3-11e7f271e06d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:54:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.670s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:54:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:54:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:54:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:54:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:54:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:13 user nova-compute[71364]: INFO nova.compute.manager [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Terminating instance
Apr 11 21:55:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-9c276f13-17be-47b2-9bad-f715db01420c req-775b8b25-8369-4bc6-a8b3-74dd18462edc service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Received event network-vif-unplugged-9e008c4e-6a6e-40b5-b6ad-74832e90044b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9c276f13-17be-47b2-9bad-f715db01420c req-775b8b25-8369-4bc6-a8b3-74dd18462edc service nova] Acquiring lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9c276f13-17be-47b2-9bad-f715db01420c req-775b8b25-8369-4bc6-a8b3-74dd18462edc service nova] Lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9c276f13-17be-47b2-9bad-f715db01420c req-775b8b25-8369-4bc6-a8b3-74dd18462edc service nova] Lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-9c276f13-17be-47b2-9bad-f715db01420c req-775b8b25-8369-4bc6-a8b3-74dd18462edc service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] No waiting events found dispatching network-vif-unplugged-9e008c4e-6a6e-40b5-b6ad-74832e90044b {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-9c276f13-17be-47b2-9bad-f715db01420c req-775b8b25-8369-4bc6-a8b3-74dd18462edc service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Received event network-vif-unplugged-9e008c4e-6a6e-40b5-b6ad-74832e90044b for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:55:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:14 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Instance destroyed successfully.
Apr 11 21:55:14 user nova-compute[71364]: DEBUG nova.objects.instance [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lazy-loading 'resources' on Instance uuid f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:55:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:53:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-179279204',display_name='tempest-VolumesAdminNegativeTest-server-179279204',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-179279204',id=12,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:53:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457b454a52ca4559b8398291e482ba70',ramdisk_id='',reservation_id='r-m5fvjwfh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1674781287',owner_user_name='tempest-VolumesAdminNegativeTest-1674781287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:53:27Z,user_data=None,user_id='37879b83a5b74e28bcde8d4885fa4ccc',uuid=f9121cd6-27a4-4c09-8eb9-3f4bb48cb934,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "address": "fa:16:3e:cc:73:21", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008c4e-6a", "ovs_interfaceid": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:55:14 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Converting VIF {"id": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "address": "fa:16:3e:cc:73:21", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e008c4e-6a", "ovs_interfaceid": "9e008c4e-6a6e-40b5-b6ad-74832e90044b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:55:14 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:73:21,bridge_name='br-int',has_traffic_filtering=True,id=9e008c4e-6a6e-40b5-b6ad-74832e90044b,network=Network(61f0f827-13c4-4f31-9a58-c653a4b3a778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e008c4e-6a') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:55:14 user nova-compute[71364]: DEBUG os_vif [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:73:21,bridge_name='br-int',has_traffic_filtering=True,id=9e008c4e-6a6e-40b5-b6ad-74832e90044b,network=Network(61f0f827-13c4-4f31-9a58-c653a4b3a778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e008c4e-6a') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:55:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e008c4e-6a, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:55:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:14 user nova-compute[71364]: INFO os_vif [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:73:21,bridge_name='br-int',has_traffic_filtering=True,id=9e008c4e-6a6e-40b5-b6ad-74832e90044b,network=Network(61f0f827-13c4-4f31-9a58-c653a4b3a778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e008c4e-6a')
Apr 11 21:55:14 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Deleting instance files /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934_del
Apr 11 21:55:14 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Deletion of /opt/stack/data/nova/instances/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934_del complete
Apr 11 21:55:14 user nova-compute[71364]: INFO nova.compute.manager [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 11 21:55:14 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:55:14 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:55:14 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:55:14 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:55:14 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Took 0.59 seconds to deallocate network for instance.
Apr 11 21:55:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:14 user nova-compute[71364]: DEBUG nova.compute.manager [req-d6386f95-fbc1-426a-91b0-a6b070cfec3d req-c461c929-66f6-4949-95fb-af191564498a service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Received event network-vif-deleted-9e008c4e-6a6e-40b5-b6ad-74832e90044b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:15 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:55:15 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:55:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:15 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Deleted allocations for instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934
Apr 11 21:55:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.065s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-1316f80e-bda9-4230-9492-23ad7158614c req-f503af2c-4b53-4899-8419-ed9ca25b867b service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Received event network-vif-plugged-9e008c4e-6a6e-40b5-b6ad-74832e90044b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1316f80e-bda9-4230-9492-23ad7158614c req-f503af2c-4b53-4899-8419-ed9ca25b867b service nova] Acquiring lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1316f80e-bda9-4230-9492-23ad7158614c req-f503af2c-4b53-4899-8419-ed9ca25b867b service nova] Lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1316f80e-bda9-4230-9492-23ad7158614c req-f503af2c-4b53-4899-8419-ed9ca25b867b service nova] Lock "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-1316f80e-bda9-4230-9492-23ad7158614c req-f503af2c-4b53-4899-8419-ed9ca25b867b service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] No waiting events found dispatching network-vif-plugged-9e008c4e-6a6e-40b5-b6ad-74832e90044b {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:15 user nova-compute[71364]: WARNING nova.compute.manager [req-1316f80e-bda9-4230-9492-23ad7158614c req-f503af2c-4b53-4899-8419-ed9ca25b867b service nova] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Received unexpected event network-vif-plugged-9e008c4e-6a6e-40b5-b6ad-74832e90044b for instance with vm_state deleted and task_state None.
Apr 11 21:55:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-1e54248e-e5df-4f33-bcae-fbfd057c6512 req-98de68d7-e18e-4665-8838-d8175cc17d7d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-changed-9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-1e54248e-e5df-4f33-bcae-fbfd057c6512 req-98de68d7-e18e-4665-8838-d8175cc17d7d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing instance network info cache due to event network-changed-9b81aa7e-ae9c-4e29-90c1-5060b7520348. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:55:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1e54248e-e5df-4f33-bcae-fbfd057c6512 req-98de68d7-e18e-4665-8838-d8175cc17d7d service nova] Acquiring lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:55:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1e54248e-e5df-4f33-bcae-fbfd057c6512 req-98de68d7-e18e-4665-8838-d8175cc17d7d service nova] Acquired lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:55:18 user nova-compute[71364]: DEBUG nova.network.neutron [req-1e54248e-e5df-4f33-bcae-fbfd057c6512 req-98de68d7-e18e-4665-8838-d8175cc17d7d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Refreshing network info cache for port 9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:55:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:19 user nova-compute[71364]: DEBUG nova.network.neutron [req-1e54248e-e5df-4f33-bcae-fbfd057c6512 req-98de68d7-e18e-4665-8838-d8175cc17d7d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updated VIF entry in instance network info cache for port 9b81aa7e-ae9c-4e29-90c1-5060b7520348. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:55:19 user nova-compute[71364]: DEBUG nova.network.neutron [req-1e54248e-e5df-4f33-bcae-fbfd057c6512 req-98de68d7-e18e-4665-8838-d8175cc17d7d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updating instance_info_cache with network_info: [{"id": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "address": "fa:16:3e:c2:28:35", "network": {"id": "04dd8b21-b308-442b-a440-e2406a2df90b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1080640877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b81aa7e-ae", "ovs_interfaceid": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "address": "fa:16:3e:d3:5d:61", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe49154e-53", "ovs_interfaceid": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "address": "fa:16:3e:52:f6:35", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953ab328-2c", "ovs_interfaceid": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "625dda14-0cd1-4178-b941-7e6a6a789011", "address": "fa:16:3e:c3:87:09", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625dda14-0c", "ovs_interfaceid": "625dda14-0cd1-4178-b941-7e6a6a789011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfa4c745-6e10-4e48-af69-924a0beade68", "address": "fa:16:3e:d7:98:4a", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa4c745-6e", "ovs_interfaceid": "dfa4c745-6e10-4e48-af69-924a0beade68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2465799c-3bee-44e6-bb98-a4db89e860a6", "address": "fa:16:3e:91:0d:66", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2465799c-3b", "ovs_interfaceid": "2465799c-3bee-44e6-bb98-a4db89e860a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "address": "fa:16:3e:35:7a:f3", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d194ea3-fd", "ovs_interfaceid": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:55:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1e54248e-e5df-4f33-bcae-fbfd057c6512 req-98de68d7-e18e-4665-8838-d8175cc17d7d service nova] Releasing lock "refresh_cache-9304294d-fdba-4499-8af2-5a781c63b7c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:20 user nova-compute[71364]: INFO nova.compute.manager [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Terminating instance
Apr 11 21:55:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-756d4913-1c73-48d5-8fa4-06dad6358d3a req-71bcc199-8372-42fd-a712-9b90dd020975 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-unplugged-9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-756d4913-1c73-48d5-8fa4-06dad6358d3a req-71bcc199-8372-42fd-a712-9b90dd020975 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-756d4913-1c73-48d5-8fa4-06dad6358d3a req-71bcc199-8372-42fd-a712-9b90dd020975 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-756d4913-1c73-48d5-8fa4-06dad6358d3a req-71bcc199-8372-42fd-a712-9b90dd020975 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-756d4913-1c73-48d5-8fa4-06dad6358d3a req-71bcc199-8372-42fd-a712-9b90dd020975 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-unplugged-9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-756d4913-1c73-48d5-8fa4-06dad6358d3a req-71bcc199-8372-42fd-a712-9b90dd020975 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-unplugged-9b81aa7e-ae9c-4e29-90c1-5060b7520348 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG nova.compute.manager [req-9e0b9dd0-f06f-4852-9eb6-44c7487ff2a8 req-f3bfb5ac-fe50-4876-857e-545e01d00887 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-unplugged-953ab328-2cc0-42c1-ab3c-4a0062140f8f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9e0b9dd0-f06f-4852-9eb6-44c7487ff2a8 req-f3bfb5ac-fe50-4876-857e-545e01d00887 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9e0b9dd0-f06f-4852-9eb6-44c7487ff2a8 req-f3bfb5ac-fe50-4876-857e-545e01d00887 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9e0b9dd0-f06f-4852-9eb6-44c7487ff2a8 req-f3bfb5ac-fe50-4876-857e-545e01d00887 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG nova.compute.manager [req-9e0b9dd0-f06f-4852-9eb6-44c7487ff2a8 req-f3bfb5ac-fe50-4876-857e-545e01d00887 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-unplugged-953ab328-2cc0-42c1-ab3c-4a0062140f8f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG nova.compute.manager [req-9e0b9dd0-f06f-4852-9eb6-44c7487ff2a8 req-f3bfb5ac-fe50-4876-857e-545e01d00887 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-unplugged-953ab328-2cc0-42c1-ab3c-4a0062140f8f for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Instance destroyed successfully.
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.objects.instance [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lazy-loading 'resources' on Instance uuid 9304294d-fdba-4499-8af2-5a781c63b7c5 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "address": "fa:16:3e:c2:28:35", "network": {"id": "04dd8b21-b308-442b-a440-e2406a2df90b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1080640877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b81aa7e-ae", "ovs_interfaceid": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "address": "fa:16:3e:c2:28:35", "network": {"id": "04dd8b21-b308-442b-a440-e2406a2df90b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1080640877-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b81aa7e-ae", "ovs_interfaceid": "9b81aa7e-ae9c-4e29-90c1-5060b7520348", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:28:35,bridge_name='br-int',has_traffic_filtering=True,id=9b81aa7e-ae9c-4e29-90c1-5060b7520348,network=Network(04dd8b21-b308-442b-a440-e2406a2df90b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b81aa7e-ae') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:28:35,bridge_name='br-int',has_traffic_filtering=True,id=9b81aa7e-ae9c-4e29-90c1-5060b7520348,network=Network(04dd8b21-b308-442b-a440-e2406a2df90b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b81aa7e-ae') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b81aa7e-ae, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: INFO os_vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:28:35,bridge_name='br-int',has_traffic_filtering=True,id=9b81aa7e-ae9c-4e29-90c1-5060b7520348,network=Network(04dd8b21-b308-442b-a440-e2406a2df90b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b81aa7e-ae')
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "address": "fa:16:3e:d3:5d:61", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe49154e-53", "ovs_interfaceid": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "address": "fa:16:3e:d3:5d:61", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe49154e-53", "ovs_interfaceid": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5d:61,bridge_name='br-int',has_traffic_filtering=True,id=be49154e-53c0-44f6-b010-8eba5fb9e0ce,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbe49154e-53') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5d:61,bridge_name='br-int',has_traffic_filtering=True,id=be49154e-53c0-44f6-b010-8eba5fb9e0ce,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbe49154e-53') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe49154e-53, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: INFO os_vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5d:61,bridge_name='br-int',has_traffic_filtering=True,id=be49154e-53c0-44f6-b010-8eba5fb9e0ce,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbe49154e-53')
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "address": "fa:16:3e:52:f6:35", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953ab328-2c", "ovs_interfaceid": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "address": "fa:16:3e:52:f6:35", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953ab328-2c", "ovs_interfaceid": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:f6:35,bridge_name='br-int',has_traffic_filtering=True,id=953ab328-2cc0-42c1-ab3c-4a0062140f8f,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap953ab328-2c') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f6:35,bridge_name='br-int',has_traffic_filtering=True,id=953ab328-2cc0-42c1-ab3c-4a0062140f8f,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap953ab328-2c') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap953ab328-2c, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: INFO os_vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f6:35,bridge_name='br-int',has_traffic_filtering=True,id=953ab328-2cc0-42c1-ab3c-4a0062140f8f,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap953ab328-2c')
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "625dda14-0cd1-4178-b941-7e6a6a789011", "address": "fa:16:3e:c3:87:09", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625dda14-0c", "ovs_interfaceid": "625dda14-0cd1-4178-b941-7e6a6a789011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "625dda14-0cd1-4178-b941-7e6a6a789011", "address": "fa:16:3e:c3:87:09", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625dda14-0c", "ovs_interfaceid": "625dda14-0cd1-4178-b941-7e6a6a789011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:87:09,bridge_name='br-int',has_traffic_filtering=True,id=625dda14-0cd1-4178-b941-7e6a6a789011,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625dda14-0c') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:87:09,bridge_name='br-int',has_traffic_filtering=True,id=625dda14-0cd1-4178-b941-7e6a6a789011,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625dda14-0c') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap625dda14-0c, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: INFO os_vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:87:09,bridge_name='br-int',has_traffic_filtering=True,id=625dda14-0cd1-4178-b941-7e6a6a789011,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap625dda14-0c')
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfa4c745-6e10-4e48-af69-924a0beade68", "address": "fa:16:3e:d7:98:4a", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa4c745-6e", "ovs_interfaceid": "dfa4c745-6e10-4e48-af69-924a0beade68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "dfa4c745-6e10-4e48-af69-924a0beade68", "address": "fa:16:3e:d7:98:4a", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa4c745-6e", "ovs_interfaceid": "dfa4c745-6e10-4e48-af69-924a0beade68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:98:4a,bridge_name='br-int',has_traffic_filtering=True,id=dfa4c745-6e10-4e48-af69-924a0beade68,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa4c745-6e') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:98:4a,bridge_name='br-int',has_traffic_filtering=True,id=dfa4c745-6e10-4e48-af69-924a0beade68,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa4c745-6e') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfa4c745-6e, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: INFO os_vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:98:4a,bridge_name='br-int',has_traffic_filtering=True,id=dfa4c745-6e10-4e48-af69-924a0beade68,network=Network(dfedf45b-b87b-4ad6-b368-72c96a3bf8a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfa4c745-6e')
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2465799c-3bee-44e6-bb98-a4db89e860a6", "address": "fa:16:3e:91:0d:66", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2465799c-3b", "ovs_interfaceid": "2465799c-3bee-44e6-bb98-a4db89e860a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "2465799c-3bee-44e6-bb98-a4db89e860a6", "address": "fa:16:3e:91:0d:66", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2465799c-3b", "ovs_interfaceid": "2465799c-3bee-44e6-bb98-a4db89e860a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:0d:66,bridge_name='br-int',has_traffic_filtering=True,id=2465799c-3bee-44e6-bb98-a4db89e860a6,network=Network(3c27ec52-a464-45d9-8095-7c39b3dc2b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2465799c-3b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:0d:66,bridge_name='br-int',has_traffic_filtering=True,id=2465799c-3bee-44e6-bb98-a4db89e860a6,network=Network(3c27ec52-a464-45d9-8095-7c39b3dc2b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2465799c-3b') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2465799c-3b, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: INFO os_vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:0d:66,bridge_name='br-int',has_traffic_filtering=True,id=2465799c-3bee-44e6-bb98-a4db89e860a6,network=Network(3c27ec52-a464-45d9-8095-7c39b3dc2b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2465799c-3b')
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-11T21:53:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-55291808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-55291808',id=13,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q==',key_name='tempest-keypair-1249594637',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:53:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c6b0f77f6e26488bb231a4148a769aa4',ramdisk_id='',reservation_id='r-9eiv0awq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-119528660',owner_user_name='tempest-TaggedBootDevicesTest-119528660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:53:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d79d201860f9413e91c6e5b80e82e7bf',uuid=9304294d-fdba-4499-8af2-5a781c63b7c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "address": "fa:16:3e:35:7a:f3", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d194ea3-fd", "ovs_interfaceid": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converting VIF {"id": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "address": "fa:16:3e:35:7a:f3", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d194ea3-fd", "ovs_interfaceid": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:7a:f3,bridge_name='br-int',has_traffic_filtering=True,id=3d194ea3-fda7-4516-8ace-0029b125ef0f,network=Network(3c27ec52-a464-45d9-8095-7c39b3dc2b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d194ea3-fd') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:7a:f3,bridge_name='br-int',has_traffic_filtering=True,id=3d194ea3-fda7-4516-8ace-0029b125ef0f,network=Network(3c27ec52-a464-45d9-8095-7c39b3dc2b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d194ea3-fd') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d194ea3-fd, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:22 user nova-compute[71364]: INFO os_vif [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:7a:f3,bridge_name='br-int',has_traffic_filtering=True,id=3d194ea3-fda7-4516-8ace-0029b125ef0f,network=Network(3c27ec52-a464-45d9-8095-7c39b3dc2b8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d194ea3-fd')
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkIWocVf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:55:22 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[694cfe0a-2701-4afd-ae68-146681917eaf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:55:22 user nova-compute[71364]: No targets found.
Apr 11 21:55:22 user nova-compute[71364]: iSNS:
Apr 11 21:55:22 user nova-compute[71364]: No targets found.
Apr 11 21:55:22 user nova-compute[71364]: STATIC:
Apr 11 21:55:22 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758
Apr 11 21:55:22 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:55:22 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:55:22 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed
Apr 11 21:55:22 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:55:22 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:55:22 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d
Apr 11 21:55:22 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:55:22 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:55:22 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722
Apr 11 21:55:22 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:55:22 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:55:22 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9
Apr 11 21:55:22 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:55:22 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:55:22 user nova-compute[71364]: FIRMWARE:
Apr 11 21:55:22 user nova-compute[71364]: No targets found.
Apr 11 21:55:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:55:22 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:55:22 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a3b23a-9e0f-44e5-8414-194eec3af625]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f93ce7-dced-4f07-9358-8ed77d0cc103]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:55:22 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:55:22 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:55:22 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:55:22 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:55:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 (non-flash)
Apr 11 21:55:22 user nova-compute[71364]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:55:22 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:55:22 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:55:22 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:55:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacff3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c26d105-9cd3-4562-8793-81cf7fca4647]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c376b78-ee0e-4f3c-8d1e-37d4215a625d]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c377d484-16d3-461c-926c-3813dc5d29fa]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[342c5e29-e864-4b79-a3d4-9fd339e13a04]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3483443e-11cd-4cec-9a9c-c4086b451db5]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f22164-b144-497c-b0f7-33a2f84c8896]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9, portal: 172.16.0.220,3260]
Apr 11 21:55:22 user nova-compute[71364]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9, portal: 172.16.0.220,3260] successful.
Apr 11 21:55:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83a59923-4f76-4871-86e2-bf7037b54cf9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[16419cf1-eaae-41b8-aa81-a3844e3ca5e3]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] <== disconnect_volume: return (293ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHhbksGX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:55:22 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e831639c-3145-4541-9707-3241d9200392]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:55:22 user nova-compute[71364]: No targets found.
Apr 11 21:55:22 user nova-compute[71364]: iSNS:
Apr 11 21:55:22 user nova-compute[71364]: No targets found.
Apr 11 21:55:22 user nova-compute[71364]: STATIC:
Apr 11 21:55:22 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758
Apr 11 21:55:22 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:55:22 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:55:22 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed
Apr 11 21:55:22 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:55:22 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:55:22 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d
Apr 11 21:55:22 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:55:22 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:55:22 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722
Apr 11 21:55:22 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:55:22 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:55:22 user nova-compute[71364]: FIRMWARE:
Apr 11 21:55:22 user nova-compute[71364]: No targets found.
Apr 11 21:55:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:55:22 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:55:22 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a353f769-4cab-4fda-84bd-bf64b66143e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9a0021-0cb2-44ad-8514-3353bb64f43e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:55:22 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:55:22 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:55:22 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:55:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed (non-flash)
Apr 11 21:55:22 user nova-compute[71364]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:55:22 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:55:22 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:55:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacf90f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed'): ({'sdc'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Removing single pathed devices sdc {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a2ec2f-3a8b-47e8-bb22-bcfc38aef9be]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b89b90e-6d73-447f-a39b-a997e563b415]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Flushing IO for device /dev/sdc {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f01732-650c-4824-bbc2-72acdb5a4d93]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:22 user nova-compute[71364]: WARNING nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-9b81aa7e-ae9c-4e29-90c1-5060b7520348 for instance with vm_state active and task_state deleting.
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-unplugged-be49154e-53c0-44f6-b010-8eba5fb9e0ce {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-unplugged-be49154e-53c0-44f6-b010-8eba5fb9e0ce {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-unplugged-be49154e-53c0-44f6-b010-8eba5fb9e0ce for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-be49154e-53c0-44f6-b010-8eba5fb9e0ce {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-be49154e-53c0-44f6-b010-8eba5fb9e0ce {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:22 user nova-compute[71364]: WARNING nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-be49154e-53c0-44f6-b010-8eba5fb9e0ce for instance with vm_state active and task_state deleting.
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-unplugged-2465799c-3bee-44e6-bb98-a4db89e860a6 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-unplugged-2465799c-3bee-44e6-bb98-a4db89e860a6 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-unplugged-2465799c-3bee-44e6-bb98-a4db89e860a6 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-2465799c-3bee-44e6-bb98-a4db89e860a6 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-2465799c-3bee-44e6-bb98-a4db89e860a6 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:22 user nova-compute[71364]: WARNING nova.compute.manager [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-2465799c-3bee-44e6-bb98-a4db89e860a6 for instance with vm_state active and task_state deleting.
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c5100c-6870-460d-8072-037248933713]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:55:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1dc397-2882-44a8-9a3f-92d477bfb3e6]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0d645a-accd-4eaa-b8bb-664ec82e505a]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed, portal: 172.16.0.220,3260]
Apr 11 21:55:23 user nova-compute[71364]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed, portal: 172.16.0.220,3260] successful.
Apr 11 21:55:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3890453-b356-4763-9d7c-ec5cca79e4ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[82174add-dd83-484b-b83b-e43df51e54d7]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] <== disconnect_volume: return (385ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DOygnwGW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:55:23 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-953ab328-2cc0-42c1-ab3c-4a0062140f8f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-953ab328-2cc0-42c1-ab3c-4a0062140f8f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:23 user nova-compute[71364]: WARNING nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-953ab328-2cc0-42c1-ab3c-4a0062140f8f for instance with vm_state active and task_state deleting.
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-unplugged-625dda14-0cd1-4178-b941-7e6a6a789011 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-unplugged-625dda14-0cd1-4178-b941-7e6a6a789011 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-unplugged-625dda14-0cd1-4178-b941-7e6a6a789011 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-625dda14-0cd1-4178-b941-7e6a6a789011 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-625dda14-0cd1-4178-b941-7e6a6a789011 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:23 user nova-compute[71364]: WARNING nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-625dda14-0cd1-4178-b941-7e6a6a789011 for instance with vm_state active and task_state deleting.
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-unplugged-dfa4c745-6e10-4e48-af69-924a0beade68 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-unplugged-dfa4c745-6e10-4e48-af69-924a0beade68 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-unplugged-dfa4c745-6e10-4e48-af69-924a0beade68 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-dfa4c745-6e10-4e48-af69-924a0beade68 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-dfa4c745-6e10-4e48-af69-924a0beade68 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:23 user nova-compute[71364]: WARNING nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-dfa4c745-6e10-4e48-af69-924a0beade68 for instance with vm_state active and task_state deleting.
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-unplugged-3d194ea3-fda7-4516-8ace-0029b125ef0f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-unplugged-3d194ea3-fda7-4516-8ace-0029b125ef0f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-unplugged-3d194ea3-fda7-4516-8ace-0029b125ef0f for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-plugged-3d194ea3-fda7-4516-8ace-0029b125ef0f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Acquiring lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] No waiting events found dispatching network-vif-plugged-3d194ea3-fda7-4516-8ace-0029b125ef0f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:23 user nova-compute[71364]: WARNING nova.compute.manager [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received unexpected event network-vif-plugged-3d194ea3-fda7-4516-8ace-0029b125ef0f for instance with vm_state active and task_state deleting.
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a20a08-deba-408b-b5e4-775f125f0eee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:55:23 user nova-compute[71364]: No targets found.
Apr 11 21:55:23 user nova-compute[71364]: iSNS:
Apr 11 21:55:23 user nova-compute[71364]: No targets found.
Apr 11 21:55:23 user nova-compute[71364]: STATIC:
Apr 11 21:55:23 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758
Apr 11 21:55:23 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:55:23 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:55:23 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d
Apr 11 21:55:23 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:55:23 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:55:23 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722
Apr 11 21:55:23 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:55:23 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:55:23 user nova-compute[71364]: FIRMWARE:
Apr 11 21:55:23 user nova-compute[71364]: No targets found.
Apr 11 21:55:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:55:23 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:55:23 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9182c44c-1462-4fc0-9f2a-2bb59d219dce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[29206fbe-8ef8-4f97-99dc-a962b3976273]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:55:23 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:55:23 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:55:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d (non-flash)
Apr 11 21:55:23 user nova-compute[71364]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:55:23 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:55:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacf90d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d'): ({'sdd'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Removing single pathed devices sdd {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a32c721-8434-4ffa-8cc5-ad37a72b200a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d8e763-ecfa-40ad-80bc-c6026d85e658]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Flushing IO for device /dev/sdd {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[665e0c28-6e64-49b3-bc15-e40868cebf73]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c441186-2706-45dc-81c6-57b44cac05bc]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f2fd1e-7927-4758-b6df-939d8e39238f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fa8495-b2e9-4489-a5bb-9a395e15da84]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d, portal: 172.16.0.220,3260]
Apr 11 21:55:23 user nova-compute[71364]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d, portal: 172.16.0.220,3260] successful.
Apr 11 21:55:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ac97080-f468-4233-9080-da800780218d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1417ff7f-0dd2-41ea-998d-4c0148a8c588]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] <== disconnect_volume: return (343ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:55:23 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Deleting instance files /opt/stack/data/nova/instances/9304294d-fdba-4499-8af2-5a781c63b7c5_del
Apr 11 21:55:23 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Deletion of /opt/stack/data/nova/instances/9304294d-fdba-4499-8af2-5a781c63b7c5_del complete
Apr 11 21:55:23 user nova-compute[71364]: INFO nova.compute.manager [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Took 3.15 seconds to destroy the instance on the hypervisor.
Apr 11 21:55:23 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:55:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-8cb8fe03-077b-4237-b816-49dbb4bc3048 req-ad0cfa00-7e70-48ee-b885-bfd85647ef55 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-deleted-9b81aa7e-ae9c-4e29-90c1-5060b7520348 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:25 user nova-compute[71364]: INFO nova.compute.manager [req-8cb8fe03-077b-4237-b816-49dbb4bc3048 req-ad0cfa00-7e70-48ee-b885-bfd85647ef55 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Neutron deleted interface 9b81aa7e-ae9c-4e29-90c1-5060b7520348; detaching it from the instance and deleting it from the info cache
Apr 11 21:55:25 user nova-compute[71364]: DEBUG nova.network.neutron [req-8cb8fe03-077b-4237-b816-49dbb4bc3048 req-ad0cfa00-7e70-48ee-b885-bfd85647ef55 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updating instance_info_cache with network_info: [{"id": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "address": "fa:16:3e:d3:5d:61", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe49154e-53", "ovs_interfaceid": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "address": "fa:16:3e:52:f6:35", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.106", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap953ab328-2c", "ovs_interfaceid": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "625dda14-0cd1-4178-b941-7e6a6a789011", "address": "fa:16:3e:c3:87:09", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap625dda14-0c", "ovs_interfaceid": "625dda14-0cd1-4178-b941-7e6a6a789011", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dfa4c745-6e10-4e48-af69-924a0beade68", "address": "fa:16:3e:d7:98:4a", "network": {"id": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "bridge": "br-int", "label": "tempest-device-tagging-net1-374907994", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfa4c745-6e", "ovs_interfaceid": "dfa4c745-6e10-4e48-af69-924a0beade68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2465799c-3bee-44e6-bb98-a4db89e860a6", "address": "fa:16:3e:91:0d:66", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2465799c-3b", "ovs_interfaceid": "2465799c-3bee-44e6-bb98-a4db89e860a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "address": "fa:16:3e:35:7a:f3", "network": {"id": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1593893343", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c6b0f77f6e26488bb231a4148a769aa4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d194ea3-fd", "ovs_interfaceid": "3d194ea3-fda7-4516-8ace-0029b125ef0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:55:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-8cb8fe03-077b-4237-b816-49dbb4bc3048 req-ad0cfa00-7e70-48ee-b885-bfd85647ef55 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Detach interface failed, port_id=9b81aa7e-ae9c-4e29-90c1-5060b7520348, reason: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 21:55:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:27 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:55:27 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Took 4.18 seconds to deallocate network for instance.
Apr 11 21:55:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-65f40edf-6719-4afc-8641-175126d2ac2f req-850d3017-c0f4-4cd8-9290-1df63f911945 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-deleted-dfa4c745-6e10-4e48-af69-924a0beade68 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-65f40edf-6719-4afc-8641-175126d2ac2f req-850d3017-c0f4-4cd8-9290-1df63f911945 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-deleted-625dda14-0cd1-4178-b941-7e6a6a789011 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-65f40edf-6719-4afc-8641-175126d2ac2f req-850d3017-c0f4-4cd8-9290-1df63f911945 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-deleted-2465799c-3bee-44e6-bb98-a4db89e860a6 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-65f40edf-6719-4afc-8641-175126d2ac2f req-850d3017-c0f4-4cd8-9290-1df63f911945 service nova] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Received event network-vif-deleted-3d194ea3-fda7-4516-8ace-0029b125ef0f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:29 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250114.1127365, f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:55:29 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] VM Stopped (Lifecycle Event)
Apr 11 21:55:29 user nova-compute[71364]: DEBUG nova.compute.manager [None req-91444142-780d-4c89-8add-de0465b9a64c None None] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:55:30 user nova-compute[71364]: INFO nova.compute.manager [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Took 2.32 seconds to detach 3 volumes for instance.
Apr 11 21:55:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:30 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:55:30 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:55:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:30 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Deleted allocations for instance 9304294d-fdba-4499-8af2-5a781c63b7c5
Apr 11 21:55:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "9304294d-fdba-4499-8af2-5a781c63b7c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.197s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:37 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250122.061899, 9304294d-fdba-4499-8af2-5a781c63b7c5 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:55:37 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] VM Stopped (Lifecycle Event)
Apr 11 21:55:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-9de54791-3bec-48c5-bd7d-b618c7f8e839 None None] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:55:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:47 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:55:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:47 user nova-compute[71364]: INFO nova.compute.manager [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Unrescuing
Apr 11 21:55:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:55:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquired lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:55:47 user nova-compute[71364]: DEBUG nova.network.neutron [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] There are 0 instances to clean {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG nova.network.neutron [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updating instance_info_cache with network_info: [{"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Releasing lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG nova.objects.instance [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'flavor' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-b24a4327-7d94-4680-bb6a-3cc3088ebe1f req-a893029a-612d-4e34-ac17-022551696ed2 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-changed-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-b24a4327-7d94-4680-bb6a-3cc3088ebe1f req-a893029a-612d-4e34-ac17-022551696ed2 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Refreshing instance network info cache due to event network-changed-20b9e448-55b1-49a6-8c39-08b2ab9755eb. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b24a4327-7d94-4680-bb6a-3cc3088ebe1f req-a893029a-612d-4e34-ac17-022551696ed2 service nova] Acquiring lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b24a4327-7d94-4680-bb6a-3cc3088ebe1f req-a893029a-612d-4e34-ac17-022551696ed2 service nova] Acquired lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG nova.network.neutron [req-b24a4327-7d94-4680-bb6a-3cc3088ebe1f req-a893029a-612d-4e34-ac17-022551696ed2 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Refreshing network info cache for port 20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-f53c2dac-50a3-43d7-b8ae-ff352a7e779d req-48d8bfb1-d369-40bb-87fb-4145f38619b8 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-vif-unplugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f53c2dac-50a3-43d7-b8ae-ff352a7e779d req-48d8bfb1-d369-40bb-87fb-4145f38619b8 service nova] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f53c2dac-50a3-43d7-b8ae-ff352a7e779d req-48d8bfb1-d369-40bb-87fb-4145f38619b8 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f53c2dac-50a3-43d7-b8ae-ff352a7e779d req-48d8bfb1-d369-40bb-87fb-4145f38619b8 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-f53c2dac-50a3-43d7-b8ae-ff352a7e779d req-48d8bfb1-d369-40bb-87fb-4145f38619b8 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] No waiting events found dispatching network-vif-unplugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:49 user nova-compute[71364]: WARNING nova.compute.manager [req-f53c2dac-50a3-43d7-b8ae-ff352a7e779d req-48d8bfb1-d369-40bb-87fb-4145f38619b8 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received unexpected event network-vif-unplugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance with vm_state rescued and task_state unrescuing.
Apr 11 21:55:49 user nova-compute[71364]: DEBUG nova.network.neutron [req-b24a4327-7d94-4680-bb6a-3cc3088ebe1f req-a893029a-612d-4e34-ac17-022551696ed2 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updated VIF entry in instance network info cache for port 20b9e448-55b1-49a6-8c39-08b2ab9755eb. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:55:49 user nova-compute[71364]: DEBUG nova.network.neutron [req-b24a4327-7d94-4680-bb6a-3cc3088ebe1f req-a893029a-612d-4e34-ac17-022551696ed2 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updating instance_info_cache with network_info: [{"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:55:49 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Instance destroyed successfully.
Apr 11 21:55:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b24a4327-7d94-4680-bb6a-3cc3088ebe1f req-a893029a-612d-4e34-ac17-022551696ed2 service nova] Releasing lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:55:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:50 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:55:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-9e518fa0-e037-4896-a14b-782e6aec12e7 req-3df5e46f-c287-4040-b54f-8faac38d06af service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-changed-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-9e518fa0-e037-4896-a14b-782e6aec12e7 req-3df5e46f-c287-4040-b54f-8faac38d06af service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Refreshing instance network info cache due to event network-changed-20b9e448-55b1-49a6-8c39-08b2ab9755eb. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:55:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9e518fa0-e037-4896-a14b-782e6aec12e7 req-3df5e46f-c287-4040-b54f-8faac38d06af service nova] Acquiring lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:55:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9e518fa0-e037-4896-a14b-782e6aec12e7 req-3df5e46f-c287-4040-b54f-8faac38d06af service nova] Acquired lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:55:50 user nova-compute[71364]: DEBUG nova.network.neutron [req-9e518fa0-e037-4896-a14b-782e6aec12e7 req-3df5e46f-c287-4040-b54f-8faac38d06af service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Refreshing network info cache for port 20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:55:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-4f208f9c-c015-4416-8bef-8b7aa1120985 req-114b91cc-df5f-4f3d-89b5-7f667fb94f80 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4f208f9c-c015-4416-8bef-8b7aa1120985 req-114b91cc-df5f-4f3d-89b5-7f667fb94f80 service nova] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4f208f9c-c015-4416-8bef-8b7aa1120985 req-114b91cc-df5f-4f3d-89b5-7f667fb94f80 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4f208f9c-c015-4416-8bef-8b7aa1120985 req-114b91cc-df5f-4f3d-89b5-7f667fb94f80 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-4f208f9c-c015-4416-8bef-8b7aa1120985 req-114b91cc-df5f-4f3d-89b5-7f667fb94f80 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] No waiting events found dispatching network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:51 user nova-compute[71364]: WARNING nova.compute.manager [req-4f208f9c-c015-4416-8bef-8b7aa1120985 req-114b91cc-df5f-4f3d-89b5-7f667fb94f80 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received unexpected event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance with vm_state rescued and task_state unrescuing.
Apr 11 21:55:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG nova.network.neutron [req-9e518fa0-e037-4896-a14b-782e6aec12e7 req-3df5e46f-c287-4040-b54f-8faac38d06af service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updated VIF entry in instance network info cache for port 20b9e448-55b1-49a6-8c39-08b2ab9755eb. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG nova.network.neutron [req-9e518fa0-e037-4896-a14b-782e6aec12e7 req-3df5e46f-c287-4040-b54f-8faac38d06af service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updating instance_info_cache with network_info: [{"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9e518fa0-e037-4896-a14b-782e6aec12e7 req-3df5e46f-c287-4040-b54f-8faac38d06af service nova] Releasing lock "refresh_cache-e627de16-3a8f-4510-8001-0e57a272b859" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:55:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for e627de16-3a8f-4510-8001-0e57a272b859 due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250153.0620627, e627de16-3a8f-4510-8001-0e57a272b859 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:55:53 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] VM Resumed (Lifecycle Event)
Apr 11 21:55:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] No waiting events found dispatching network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:53 user nova-compute[71364]: WARNING nova.compute.manager [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received unexpected event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance with vm_state rescued and task_state unrescuing.
Apr 11 21:55:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] No waiting events found dispatching network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:55:53 user nova-compute[71364]: WARNING nova.compute.manager [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received unexpected event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance with vm_state rescued and task_state unrescuing.
Apr 11 21:55:53 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 21:55:53 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250153.0739276, e627de16-3a8f-4510-8001-0e57a272b859 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:55:53 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] VM Started (Lifecycle Event)
Apr 11 21:55:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:55 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:55:55 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7558MB free_disk=26.220409393310547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance e627de16-3a8f-4510-8001-0e57a272b859 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76315af2-c4b9-4ad5-98ea-81826524d63e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d4aa732e-7598-443e-96f3-11e7f271e06d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing inventories for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating ProviderTree inventory for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating inventory in ProviderTree for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing aggregate associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, aggregates: None {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing trait associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.771s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71364) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 21:55:55 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:55:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "3915859d-4e2f-4568-9b02-d0733a474749" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:56 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:55:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:55:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:55:56 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:55:56 user nova-compute[71364]: INFO nova.compute.claims [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Claim successful on node user
Apr 11 21:55:57 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG nova.network.neutron [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:55:57 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:55:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:55:57 user nova-compute[71364]: INFO nova.virt.block_device [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Booting with volume f165ecee-978a-47fa-a8ae-bee74bf26b44 at /dev/vda
Apr 11 21:55:57 user nova-compute[71364]: DEBUG nova.policy [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1eb9c1fa13245dfbf9cdecd163e8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204710ef9e04099a7397acd2b027f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG os_brick.utils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[985c59a3-3d69-472f-964f-cab6728000c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[15364fb1-820d-4167-b02c-59b245d7f5d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[74106fd4-58be-4a26-9fa8-7cc6e060b091]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bdf1e2-069c-4f30-9215-c5c0ab9100fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:55:57 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd154387-d25e-4229-8965-4f5596d896f0]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG os_brick.utils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updating existing volume attachment record: dc065ef9-1f7d-4e93-a29c-55e0c0d33262 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Didn't find any instances for network info cache update. {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:55:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:55:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Successfully created port: 5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:55:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:55:59 user nova-compute[71364]: DEBUG nova.network.neutron [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Successfully updated port: 5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:55:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:55:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquired lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:55:59 user nova-compute[71364]: DEBUG nova.network.neutron [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:55:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-01234613-0686-4762-8531-3cefaa1621bb req-014af9cb-9bc2-439c-bb5c-aa01fcc6f9ee service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-changed-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:55:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-01234613-0686-4762-8531-3cefaa1621bb req-014af9cb-9bc2-439c-bb5c-aa01fcc6f9ee service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Refreshing instance network info cache due to event network-changed-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:55:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-01234613-0686-4762-8531-3cefaa1621bb req-014af9cb-9bc2-439c-bb5c-aa01fcc6f9ee service nova] Acquiring lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:55:59 user nova-compute[71364]: DEBUG nova.network.neutron [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:55:59 user nova-compute[71364]: DEBUG nova.network.neutron [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updating instance_info_cache with network_info: [{"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:55:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Releasing lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:55:59 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Instance network_info: |[{"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:55:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-01234613-0686-4762-8531-3cefaa1621bb req-014af9cb-9bc2-439c-bb5c-aa01fcc6f9ee service nova] Acquired lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:55:59 user nova-compute[71364]: DEBUG nova.network.neutron [req-01234613-0686-4762-8531-3cefaa1621bb req-014af9cb-9bc2-439c-bb5c-aa01fcc6f9ee service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Refreshing network info cache for port 5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:56:00 user nova-compute[71364]: DEBUG nova.network.neutron [req-01234613-0686-4762-8531-3cefaa1621bb req-014af9cb-9bc2-439c-bb5c-aa01fcc6f9ee service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updated VIF entry in instance network info cache for port 5ea4b5fb-b111-488e-b1e4-15e0a63b3b83. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:56:00 user nova-compute[71364]: DEBUG nova.network.neutron [req-01234613-0686-4762-8531-3cefaa1621bb req-014af9cb-9bc2-439c-bb5c-aa01fcc6f9ee service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updating instance_info_cache with network_info: [{"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:56:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-01234613-0686-4762-8531-3cefaa1621bb req-014af9cb-9bc2-439c-bb5c-aa01fcc6f9ee service nova] Releasing lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:56:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "d4aa732e-7598-443e-96f3-11e7f271e06d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "d4aa732e-7598-443e-96f3-11e7f271e06d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:00 user nova-compute[71364]: INFO nova.compute.manager [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Terminating instance
Apr 11 21:56:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:56:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Received event network-vif-unplugged-2bd3732b-13bc-4017-891e-c808fd4d9b1f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] Acquiring lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] Lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] Lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] No waiting events found dispatching network-vif-unplugged-2bd3732b-13bc-4017-891e-c808fd4d9b1f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Received event network-vif-unplugged-2bd3732b-13bc-4017-891e-c808fd4d9b1f for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Received event network-vif-plugged-2bd3732b-13bc-4017-891e-c808fd4d9b1f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] Acquiring lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] Lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] Lock "d4aa732e-7598-443e-96f3-11e7f271e06d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] No waiting events found dispatching network-vif-plugged-2bd3732b-13bc-4017-891e-c808fd4d9b1f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:56:01 user nova-compute[71364]: WARNING nova.compute.manager [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Received unexpected event network-vif-plugged-2bd3732b-13bc-4017-891e-c808fd4d9b1f for instance with vm_state active and task_state deleting.
Apr 11 21:56:01 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Instance destroyed successfully.
Apr 11 21:56:01 user nova-compute[71364]: DEBUG nova.objects.instance [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lazy-loading 'resources' on Instance uuid d4aa732e-7598-443e-96f3-11e7f271e06d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1286349447',display_name='tempest-VolumesActionsTest-instance-1286349447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1286349447',id=14,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='196d39dc81df44958f2e403a3a41030f',ramdisk_id='',reservation_id='r-u9x1gfox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-606140534',owner_user_name='tempest-VolumesActionsTest-606140534-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:54:15Z,user_data=None,user_id='10feb9f12b2b4742808e9c06da370031',uuid=d4aa732e-7598-443e-96f3-11e7f271e06d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "address": "fa:16:3e:6d:6c:7d", "network": {"id": "4542f6c1-28e3-484e-b117-6f228cb1ad27", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532935468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "196d39dc81df44958f2e403a3a41030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd3732b-13", "ovs_interfaceid": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Converting VIF {"id": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "address": "fa:16:3e:6d:6c:7d", "network": {"id": "4542f6c1-28e3-484e-b117-6f228cb1ad27", "bridge": "br-int", "label": "tempest-VolumesActionsTest-532935468-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "196d39dc81df44958f2e403a3a41030f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bd3732b-13", "ovs_interfaceid": "2bd3732b-13bc-4017-891e-c808fd4d9b1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6c:7d,bridge_name='br-int',has_traffic_filtering=True,id=2bd3732b-13bc-4017-891e-c808fd4d9b1f,network=Network(4542f6c1-28e3-484e-b117-6f228cb1ad27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd3732b-13') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG os_vif [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6c:7d,bridge_name='br-int',has_traffic_filtering=True,id=2bd3732b-13bc-4017-891e-c808fd4d9b1f,network=Network(4542f6c1-28e3-484e-b117-6f228cb1ad27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd3732b-13') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bd3732b-13, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:01 user nova-compute[71364]: INFO os_vif [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:6c:7d,bridge_name='br-int',has_traffic_filtering=True,id=2bd3732b-13bc-4017-891e-c808fd4d9b1f,network=Network(4542f6c1-28e3-484e-b117-6f228cb1ad27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bd3732b-13')
Apr 11 21:56:01 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Deleting instance files /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d_del
Apr 11 21:56:01 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Deletion of /opt/stack/data/nova/instances/d4aa732e-7598-443e-96f3-11e7f271e06d_del complete
Apr 11 21:56:01 user nova-compute[71364]: INFO nova.compute.manager [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 21:56:01 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:56:01 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:56:02 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Took 0.53 seconds to deallocate network for instance.
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:56:02 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Creating image(s)
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Ensure instance console log exists: /opt/stack/data/nova/instances/3915859d-4e2f-4568-9b02-d0733a474749/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Start _get_guest_xml network_info=[{"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQEUSMDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3915859d-4e2f-4568-9b02-d0733a474749', 'attached_at': '', 'detached_at': '', 'volume_id': 'f165ecee-978a-47fa-a8ae-bee74bf26b44', 'serial': 'f165ecee-978a-47fa-a8ae-bee74bf26b44'}, 'attachment_id': 'dc065ef9-1f7d-4e93-a29c-55e0c0d33262', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:56:02 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:56:02 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQEUSMDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:56:02 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:56:02 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:56:02 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb2c7c2-0073-4f9c-8607-307b488b08e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:56:02 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe352c1-9913-474c-96d5-5a9650671f8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44] added
Apr 11 21:56:02 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[96941726-d2e2-4d0d-8d30-ab348b7ffafd]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d50a7da-9838-4966-9fb4-c32f80a66783]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yQEUSMDw {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yQEUSMDw" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c92cce-a78f-4392-a066-a499c7dcf781]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yQEUSMDw'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abfcf94-3e0f-4fbf-9619-f08adf3419e5]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aa6b47-8b6b-4c82-b5ef-dfc9666f4b45]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:56:02 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:56:02 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:56:02 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:56:02 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fdbe33-614e-4d54-a2e5-ebe0376f81b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260]
Apr 11 21:56:02 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260] successful.
Apr 11 21:56:02 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9e2079-f5f4-4e61-beb8-ab42541a773b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0782cf-c943-4be6-9581-dbdd72a9cf7d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:56:02 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:56:02 user nova-compute[71364]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:56:02 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:56:02 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:56:02 user nova-compute[71364]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:56:02 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e044a27-d6a7-4ffd-95b5-915a958076c6]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQEUSMDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.552s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:02 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Deleted allocations for instance d4aa732e-7598-443e-96f3-11e7f271e06d
Apr 11 21:56:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "d4aa732e-7598-443e-96f3-11e7f271e06d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.143s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-53ba2ac8-b8a2-45b3-9f41-bce0e1f47d59 req-4b6c749c-cd36-4c01-9167-83e1e10a3e79 service nova] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Received event network-vif-deleted-2bd3732b-13bc-4017-891e-c808fd4d9b1f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:03 user nova-compute[71364]: INFO nova.compute.manager [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] instance snapshotting
Apr 11 21:56:03 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Beginning live snapshot process
Apr 11 21:56:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json -f qcow2 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23434333266353538', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434333266353538', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-115257149',display_name='tempest-TestShelveInstance-server-115257149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-115257149',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyPTe9feerqVheMVPWgzAKCwaFOC9ArUtF6J+R4E3viM31y/cbRBAgN/fGGscghWK4rwcLJmmvX/JrdODSYEj5x0YZG9e58kVgIYJHTsbGEhKAGRr3PK3K9OZefO9EywQ==',key_name='tempest-TestShelveInstance-413583393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6204710ef9e04099a7397acd2b027f15',ramdisk_id='',reservation_id='r-4z4pjiv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2116780630',owner_user_name='tempest-TestShelveInstance-2116780630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:55:58Z,user_data=None,user_id='f1eb9c1fa13245dfbf9cdecd163e8e21',uuid=3915859d-4e2f-4568-9b02-d0733a474749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Converting VIF {"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83,network=Network(2fa04b01-8810-4143-8c46-44a06e013c98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea4b5fb-b1') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG nova.objects.instance [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lazy-loading 'pci_devices' on Instance uuid 3915859d-4e2f-4568-9b02-d0733a474749 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:56:03 user nova-compute[71364]:   <uuid>3915859d-4e2f-4568-9b02-d0733a474749</uuid>
Apr 11 21:56:03 user nova-compute[71364]:   <name>instance-00000013</name>
Apr 11 21:56:03 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:56:03 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:56:03 user nova-compute[71364]:   <metadata>
Apr 11 21:56:03 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:56:03 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:56:03 user nova-compute[71364]:       <nova:name>tempest-TestShelveInstance-server-115257149</nova:name>
Apr 11 21:56:03 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:56:02</nova:creationTime>
Apr 11 21:56:03 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:56:03 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:56:03 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:56:03 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:56:03 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:56:03 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:56:03 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:56:03 user nova-compute[71364]:       <nova:owner>
Apr 11 21:56:03 user nova-compute[71364]:         <nova:user uuid="f1eb9c1fa13245dfbf9cdecd163e8e21">tempest-TestShelveInstance-2116780630-project-member</nova:user>
Apr 11 21:56:03 user nova-compute[71364]:         <nova:project uuid="6204710ef9e04099a7397acd2b027f15">tempest-TestShelveInstance-2116780630</nova:project>
Apr 11 21:56:03 user nova-compute[71364]:       </nova:owner>
Apr 11 21:56:03 user nova-compute[71364]:       <nova:ports>
Apr 11 21:56:03 user nova-compute[71364]:         <nova:port uuid="5ea4b5fb-b111-488e-b1e4-15e0a63b3b83">
Apr 11 21:56:03 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 21:56:03 user nova-compute[71364]:         </nova:port>
Apr 11 21:56:03 user nova-compute[71364]:       </nova:ports>
Apr 11 21:56:03 user nova-compute[71364]:     </nova:instance>
Apr 11 21:56:03 user nova-compute[71364]:   </metadata>
Apr 11 21:56:03 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:56:03 user nova-compute[71364]:     <system>
Apr 11 21:56:03 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:56:03 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:56:03 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:56:03 user nova-compute[71364]:       <entry name="serial">3915859d-4e2f-4568-9b02-d0733a474749</entry>
Apr 11 21:56:03 user nova-compute[71364]:       <entry name="uuid">3915859d-4e2f-4568-9b02-d0733a474749</entry>
Apr 11 21:56:03 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:56:03 user nova-compute[71364]:     </system>
Apr 11 21:56:03 user nova-compute[71364]:   </sysinfo>
Apr 11 21:56:03 user nova-compute[71364]:   <os>
Apr 11 21:56:03 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:56:03 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:56:03 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:56:03 user nova-compute[71364]:   </os>
Apr 11 21:56:03 user nova-compute[71364]:   <features>
Apr 11 21:56:03 user nova-compute[71364]:     <acpi/>
Apr 11 21:56:03 user nova-compute[71364]:     <apic/>
Apr 11 21:56:03 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:56:03 user nova-compute[71364]:   </features>
Apr 11 21:56:03 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:56:03 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:56:03 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:56:03 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:56:03 user nova-compute[71364]:   </clock>
Apr 11 21:56:03 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:56:03 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:56:03 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:56:03 user nova-compute[71364]:   </cpu>
Apr 11 21:56:03 user nova-compute[71364]:   <devices>
Apr 11 21:56:03 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 21:56:03 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:56:03 user nova-compute[71364]:       <source dev="/dev/sdb"/>
Apr 11 21:56:03 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:56:03 user nova-compute[71364]:       <serial>f165ecee-978a-47fa-a8ae-bee74bf26b44</serial>
Apr 11 21:56:03 user nova-compute[71364]:     </disk>
Apr 11 21:56:03 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:56:03 user nova-compute[71364]:       <mac address="fa:16:3e:69:cd:e6"/>
Apr 11 21:56:03 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:56:03 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:56:03 user nova-compute[71364]:       <target dev="tap5ea4b5fb-b1"/>
Apr 11 21:56:03 user nova-compute[71364]:     </interface>
Apr 11 21:56:03 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:56:03 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/3915859d-4e2f-4568-9b02-d0733a474749/console.log" append="off"/>
Apr 11 21:56:03 user nova-compute[71364]:     </serial>
Apr 11 21:56:03 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:56:03 user nova-compute[71364]:     <video>
Apr 11 21:56:03 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:56:03 user nova-compute[71364]:     </video>
Apr 11 21:56:03 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:56:03 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:56:03 user nova-compute[71364]:     </rng>
Apr 11 21:56:03 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:56:03 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:56:03 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:56:03 user nova-compute[71364]:     </memballoon>
Apr 11 21:56:03 user nova-compute[71364]:   </devices>
Apr 11 21:56:03 user nova-compute[71364]: </domain>
Apr 11 21:56:03 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-115257149',display_name='tempest-TestShelveInstance-server-115257149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-115257149',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyPTe9feerqVheMVPWgzAKCwaFOC9ArUtF6J+R4E3viM31y/cbRBAgN/fGGscghWK4rwcLJmmvX/JrdODSYEj5x0YZG9e58kVgIYJHTsbGEhKAGRr3PK3K9OZefO9EywQ==',key_name='tempest-TestShelveInstance-413583393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6204710ef9e04099a7397acd2b027f15',ramdisk_id='',reservation_id='r-4z4pjiv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2116780630',owner_user_name='tempest-TestShelveInstance-2116780630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:55:58Z,user_data=None,user_id='f1eb9c1fa13245dfbf9cdecd163e8e21',uuid=3915859d-4e2f-4568-9b02-d0733a474749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Converting VIF {"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83,network=Network(2fa04b01-8810-4143-8c46-44a06e013c98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea4b5fb-b1') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG os_vif [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83,network=Network(2fa04b01-8810-4143-8c46-44a06e013c98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea4b5fb-b1') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ea4b5fb-b1, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ea4b5fb-b1, col_values=(('external_ids', {'iface-id': '5ea4b5fb-b111-488e-b1e4-15e0a63b3b83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:cd:e6', 'vm-uuid': '3915859d-4e2f-4568-9b02-d0733a474749'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:03 user nova-compute[71364]: INFO os_vif [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83,network=Network(2fa04b01-8810-4143-8c46-44a06e013c98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea4b5fb-b1')
Apr 11 21:56:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json -f qcow2 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] No VIF found with MAC fa:16:3e:69:cd:e6, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json -f qcow2" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_hc5kbsw/c15e005db1574bc89ac8db86313b84b3.delta 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_hc5kbsw/c15e005db1574bc89ac8db86313b84b3.delta 1073741824" returned: 0 in 0.046s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:04 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 21:56:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] COPY block job progress, current cursor: 524288 final cursor: 43778048 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:56:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 21:56:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 21:56:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-22caa827-fd6e-4990-b4be-215a7e770f5d req-ac8e7d8d-c323-45c7-86b9-81ed25d06f7a service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-22caa827-fd6e-4990-b4be-215a7e770f5d req-ac8e7d8d-c323-45c7-86b9-81ed25d06f7a service nova] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-22caa827-fd6e-4990-b4be-215a7e770f5d req-ac8e7d8d-c323-45c7-86b9-81ed25d06f7a service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-22caa827-fd6e-4990-b4be-215a7e770f5d req-ac8e7d8d-c323-45c7-86b9-81ed25d06f7a service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-22caa827-fd6e-4990-b4be-215a7e770f5d req-ac8e7d8d-c323-45c7-86b9-81ed25d06f7a service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] No waiting events found dispatching network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:56:06 user nova-compute[71364]: WARNING nova.compute.manager [req-22caa827-fd6e-4990-b4be-215a7e770f5d req-ac8e7d8d-c323-45c7-86b9-81ed25d06f7a service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received unexpected event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance with vm_state building and task_state spawning.
Apr 11 21:56:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:06 user nova-compute[71364]: INFO nova.compute.manager [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Terminating instance
Apr 11 21:56:06 user nova-compute[71364]: DEBUG nova.compute.manager [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_hc5kbsw/c15e005db1574bc89ac8db86313b84b3.delta /opt/stack/data/nova/instances/snapshots/tmp_hc5kbsw/c15e005db1574bc89ac8db86313b84b3 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_hc5kbsw/c15e005db1574bc89ac8db86313b84b3.delta /opt/stack/data/nova/instances/snapshots/tmp_hc5kbsw/c15e005db1574bc89ac8db86313b84b3" returned: 0 in 0.290s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Snapshot extracted, beginning image upload
Apr 11 21:56:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-5c476ac9-805c-4403-b4e6-ba792c88961f req-471c4952-a0dd-4c3e-9e61-e407bac64491 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Received event network-vif-unplugged-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5c476ac9-805c-4403-b4e6-ba792c88961f req-471c4952-a0dd-4c3e-9e61-e407bac64491 service nova] Acquiring lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5c476ac9-805c-4403-b4e6-ba792c88961f req-471c4952-a0dd-4c3e-9e61-e407bac64491 service nova] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5c476ac9-805c-4403-b4e6-ba792c88961f req-471c4952-a0dd-4c3e-9e61-e407bac64491 service nova] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-5c476ac9-805c-4403-b4e6-ba792c88961f req-471c4952-a0dd-4c3e-9e61-e407bac64491 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] No waiting events found dispatching network-vif-unplugged-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-5c476ac9-805c-4403-b4e6-ba792c88961f req-471c4952-a0dd-4c3e-9e61-e407bac64491 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Received event network-vif-unplugged-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Instance destroyed successfully.
Apr 11 21:56:06 user nova-compute[71364]: DEBUG nova.objects.instance [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lazy-loading 'resources' on Instance uuid 71a04a77-49b8-4d4a-bc66-e233aa7eab08 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:50:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1562113130',display_name='tempest-VolumesAdminNegativeTest-server-1562113130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1562113130',id=7,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRDQbClyWjaWVMh/dFS8MH10Zkv2DPV56TNsv7KqLPCcSdaXoJ9t+c79OwigEZhCLe+pIkQkR/X3KHrwaqVQOn3MrgLwKyHSIl0SfrEul3klmry4bD1s8GoQO+cmcZXvA==',key_name='tempest-keypair-327855003',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457b454a52ca4559b8398291e482ba70',ramdisk_id='',reservation_id='r-glmyvjy8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1674781287',owner_user_name='tempest-VolumesAdminNegativeTest-1674781287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:50:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37879b83a5b74e28bcde8d4885fa4ccc',uuid=71a04a77-49b8-4d4a-bc66-e233aa7eab08,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "address": "fa:16:3e:c2:69:1f", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7ba51-43", "ovs_interfaceid": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:56:07 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Converting VIF {"id": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "address": "fa:16:3e:c2:69:1f", "network": {"id": "61f0f827-13c4-4f31-9a58-c653a4b3a778", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1094529132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457b454a52ca4559b8398291e482ba70", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bf7ba51-43", "ovs_interfaceid": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:56:07 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:69:1f,bridge_name='br-int',has_traffic_filtering=True,id=2bf7ba51-4360-45c5-bada-6d7113ca3aa5,network=Network(61f0f827-13c4-4f31-9a58-c653a4b3a778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf7ba51-43') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:56:07 user nova-compute[71364]: DEBUG os_vif [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:69:1f,bridge_name='br-int',has_traffic_filtering=True,id=2bf7ba51-4360-45c5-bada-6d7113ca3aa5,network=Network(61f0f827-13c4-4f31-9a58-c653a4b3a778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf7ba51-43') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:56:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bf7ba51-43, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:56:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:56:07 user nova-compute[71364]: INFO os_vif [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:69:1f,bridge_name='br-int',has_traffic_filtering=True,id=2bf7ba51-4360-45c5-bada-6d7113ca3aa5,network=Network(61f0f827-13c4-4f31-9a58-c653a4b3a778),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bf7ba51-43')
Apr 11 21:56:07 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Deleting instance files /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08_del
Apr 11 21:56:07 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Deletion of /opt/stack/data/nova/instances/71a04a77-49b8-4d4a-bc66-e233aa7eab08_del complete
Apr 11 21:56:07 user nova-compute[71364]: INFO nova.compute.manager [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 11 21:56:07 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:56:07 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:56:07 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250168.1671777, 3915859d-4e2f-4568-9b02-d0733a474749 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:56:08 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] VM Resumed (Lifecycle Event)
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:56:08 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Instance spawned successfully.
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-b3fd6ff8-56cf-4c4f-b1fa-184cdc127333 req-6c45a0a9-cb80-4524-8330-6cd75fa5b0c7 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b3fd6ff8-56cf-4c4f-b1fa-184cdc127333 req-6c45a0a9-cb80-4524-8330-6cd75fa5b0c7 service nova] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b3fd6ff8-56cf-4c4f-b1fa-184cdc127333 req-6c45a0a9-cb80-4524-8330-6cd75fa5b0c7 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b3fd6ff8-56cf-4c4f-b1fa-184cdc127333 req-6c45a0a9-cb80-4524-8330-6cd75fa5b0c7 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-b3fd6ff8-56cf-4c4f-b1fa-184cdc127333 req-6c45a0a9-cb80-4524-8330-6cd75fa5b0c7 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] No waiting events found dispatching network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:56:08 user nova-compute[71364]: WARNING nova.compute.manager [req-b3fd6ff8-56cf-4c4f-b1fa-184cdc127333 req-6c45a0a9-cb80-4524-8330-6cd75fa5b0c7 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received unexpected event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance with vm_state building and task_state spawning.
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:56:08 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Took 0.88 seconds to deallocate network for instance.
Apr 11 21:56:08 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250168.168029, 3915859d-4e2f-4568-9b02-d0733a474749 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:56:08 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] VM Started (Lifecycle Event)
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-aef6c954-44e5-473b-88ee-0d54811169cd req-320e8264-2ae6-4f5d-9340-7cb2961c4272 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Received event network-vif-deleted-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:08 user nova-compute[71364]: INFO nova.compute.manager [req-aef6c954-44e5-473b-88ee-0d54811169cd req-320e8264-2ae6-4f5d-9340-7cb2961c4272 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Neutron deleted interface 2bf7ba51-4360-45c5-bada-6d7113ca3aa5; detaching it from the instance and deleting it from the info cache
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.network.neutron [req-aef6c954-44e5-473b-88ee-0d54811169cd req-320e8264-2ae6-4f5d-9340-7cb2961c4272 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-aef6c954-44e5-473b-88ee-0d54811169cd req-320e8264-2ae6-4f5d-9340-7cb2961c4272 service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Detach interface failed, port_id=2bf7ba51-4360-45c5-bada-6d7113ca3aa5, reason: Instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 21:56:08 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.objects.instance [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lazy-loading 'flavor' on Instance uuid 906866ce-6f86-4036-8b39-76b3e7d7c1fb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:08 user nova-compute[71364]: INFO nova.compute.manager [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Took 6.17 seconds to spawn the instance on the hypervisor.
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.108s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:08 user nova-compute[71364]: INFO nova.compute.manager [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Took 11.57 seconds to build instance.
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "3915859d-4e2f-4568-9b02-d0733a474749" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.666s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:08 user nova-compute[71364]: INFO nova.compute.manager [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Attaching volume b2803239-af94-45ee-b489-9c8d57ffc17d to /dev/vdb
Apr 11 21:56:08 user nova-compute[71364]: DEBUG os_brick.utils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6159eb90-cd1c-47b2-8269-c9c76f6068b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77e3b6a-e307-48c6-8bba-7f9ab879bee7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[590760e7-0227-4b00-ad85-c81bb0b96832]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1280f0-1e88-49db-8fb6-10e25f3fac78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:56:08 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[50100d89-9eb8-46c5-99c4-0d630c33c409]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Received event network-vif-plugged-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] Acquiring lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] No waiting events found dispatching network-vif-plugged-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:56:08 user nova-compute[71364]: WARNING nova.compute.manager [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Received unexpected event network-vif-plugged-2bf7ba51-4360-45c5-bada-6d7113ca3aa5 for instance with vm_state deleted and task_state None.
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Received event network-changed-bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Refreshing instance network info cache due to event network-changed-bfd12cce-c416-4b40-a9f4-323c2de32995. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] Acquiring lock "refresh_cache-906866ce-6f86-4036-8b39-76b3e7d7c1fb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] Acquired lock "refresh_cache-906866ce-6f86-4036-8b39-76b3e7d7c1fb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.network.neutron [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Refreshing network info cache for port bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG os_brick.utils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Updating existing volume attachment record: a70bc510-e111-4e34-8ebd-a159f841dec0 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.558s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:09 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Deleted allocations for instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08
Apr 11 21:56:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "71a04a77-49b8-4d4a-bc66-e233aa7eab08" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.926s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:09 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Snapshot image upload complete
Apr 11 21:56:09 user nova-compute[71364]: INFO nova.compute.manager [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Took 5.73 seconds to snapshot the instance on the hypervisor.
Apr 11 21:56:09 user nova-compute[71364]: DEBUG nova.network.neutron [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Updated VIF entry in instance network info cache for port bfd12cce-c416-4b40-a9f4-323c2de32995. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:56:09 user nova-compute[71364]: DEBUG nova.network.neutron [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Updating instance_info_cache with network_info: [{"id": "bfd12cce-c416-4b40-a9f4-323c2de32995", "address": "fa:16:3e:7f:95:3a", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd12cce-c4", "ovs_interfaceid": "bfd12cce-c416-4b40-a9f4-323c2de32995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:56:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] Releasing lock "refresh_cache-906866ce-6f86-4036-8b39-76b3e7d7c1fb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:56:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OdTlGXCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:56:13 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:56:13 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:56:13 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b668ee-2b86-4a3f-b4fd-dc876a1589db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:56:13 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e497551-b380-448f-bc09-9981f1e11e7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d] added
Apr 11 21:56:13 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2962d0b9-e15c-45d6-994c-e45fde78cd49]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de7c0f7-d329-440d-a94f-5815f6fc3379]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OdTlGXCi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OdTlGXCi" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[446d478f-c6d2-4434-900c-52dad4349933]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OdTlGXCi'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[47634ed9-cb97-41d9-9c0b-87ce02d85229]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba335c10-be6e-4b03-808b-289f256c6952]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:56:13 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:56:13 user nova-compute[71364]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:56:13 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:56:13 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:56:13 user nova-compute[71364]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:56:13 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2663a7-896e-4c8d-866d-5a7ea4c6e50a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d, portal: 172.16.0.220,3260]
Apr 11 21:56:13 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d, portal: 172.16.0.220,3260] successful.
Apr 11 21:56:13 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d361b717-e46d-458e-a4f0-05a5a96ec940]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97124a5-6808-4adb-85f6-725749029b55]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:56:13 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:56:13 user nova-compute[71364]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:56:13 user nova-compute[71364]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d (non-flash)
Apr 11 21:56:13 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:56:13 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:56:13 user nova-compute[71364]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:56:13 user nova-compute[71364]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d (non-flash)
Apr 11 21:56:13 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02eea28-f50e-41ca-9503-76e9c951e868]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OdTlGXCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:56:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:56:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23636363861636430', 'path': '/dev/sdc'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:56:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636363861636430', 'path': '/dev/sdc'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:56:14 user nova-compute[71364]: DEBUG nova.objects.instance [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lazy-loading 'flavor' on Instance uuid 906866ce-6f86-4036-8b39-76b3e7d7c1fb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:56:14 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:56:14 user nova-compute[71364]:   <source dev="/dev/sdc"/>
Apr 11 21:56:14 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:56:14 user nova-compute[71364]:   <serial>b2803239-af94-45ee-b489-9c8d57ffc17d</serial>
Apr 11 21:56:14 user nova-compute[71364]: </disk>
Apr 11 21:56:14 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:56:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:56:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:56:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] No VIF found with MAC fa:16:3e:7f:95:3a, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:56:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.646s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:16 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250161.5631962, d4aa732e-7598-443e-96f3-11e7f271e06d => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:56:16 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] VM Stopped (Lifecycle Event)
Apr 11 21:56:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-93513a82-e52b-49be-9615-c47f8126747b None None] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:56:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:16 user nova-compute[71364]: INFO nova.compute.manager [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Detaching volume b2803239-af94-45ee-b489-9c8d57ffc17d
Apr 11 21:56:16 user nova-compute[71364]: INFO nova.virt.block_device [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Attempting to driver detach volume b2803239-af94-45ee-b489-9c8d57ffc17d from mountpoint /dev/vdb
Apr 11 21:56:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Attempting to detach device vdb from instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:56:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:56:16 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:56:16 user nova-compute[71364]:   <source dev="/dev/sdc"/>
Apr 11 21:56:16 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:56:16 user nova-compute[71364]:   <serial>b2803239-af94-45ee-b489-9c8d57ffc17d</serial>
Apr 11 21:56:16 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:56:16 user nova-compute[71364]: </disk>
Apr 11 21:56:16 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:56:16 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Successfully detached device vdb from instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb from the persistent domain config.
Apr 11 21:56:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:56:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:56:16 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:56:16 user nova-compute[71364]:   <source dev="/dev/sdc"/>
Apr 11 21:56:16 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:56:16 user nova-compute[71364]:   <serial>b2803239-af94-45ee-b489-9c8d57ffc17d</serial>
Apr 11 21:56:16 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:56:16 user nova-compute[71364]: </disk>
Apr 11 21:56:16 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681250177.3432028, 906866ce-6f86-4036-8b39-76b3e7d7c1fb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:56:17 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Successfully detached device vdb from instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb from the live domain config.
Apr 11 21:56:17 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OdTlGXCi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:56:17 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[574d927d-318f-445f-86fb-b9d23bcd5efb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:56:17 user nova-compute[71364]: No targets found.
Apr 11 21:56:17 user nova-compute[71364]: iSNS:
Apr 11 21:56:17 user nova-compute[71364]: No targets found.
Apr 11 21:56:17 user nova-compute[71364]: STATIC:
Apr 11 21:56:17 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758
Apr 11 21:56:17 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:56:17 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:56:17 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44
Apr 11 21:56:17 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:56:17 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:56:17 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d
Apr 11 21:56:17 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:56:17 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:56:17 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722
Apr 11 21:56:17 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:56:17 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:56:17 user nova-compute[71364]: FIRMWARE:
Apr 11 21:56:17 user nova-compute[71364]: No targets found.
Apr 11 21:56:17 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:56:17 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:56:17 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[744ff607-bc80-449f-9b04-8e10a194d73b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b49ebb-ceee-479d-bf2b-330fda67ece0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:56:17 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:56:17 user nova-compute[71364]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:56:17 user nova-compute[71364]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d (non-flash)
Apr 11 21:56:17 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:56:17 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:56:17 user nova-compute[71364]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:56:17 user nova-compute[71364]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d (non-flash)
Apr 11 21:56:17 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacc37c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d'): ({'sdc'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Removing single pathed devices sdc {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[129dbd9f-9fa4-40c7-b0b7-b56b2fd9289c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[01643eb7-6507-423a-8e2b-2746cc882a54]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Flushing IO for device /dev/sdc {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8305c403-9034-4f41-9ea8-39d953d81ca4]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[301c130d-28e9-4ad0-9fe1-b5c303f417f4]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[834522eb-6f2a-4e46-8732-7054d59cc0e2]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a487c1a6-5db4-4786-a206-1364459905f6]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d, portal: 172.16.0.220,3260]
Apr 11 21:56:17 user nova-compute[71364]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d, portal: 172.16.0.220,3260] successful.
Apr 11 21:56:17 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2803239-af94-45ee-b489-9c8d57ffc17d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[75db04c6-5a63-4d44-9268-4fc7f6bbd81e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] <== disconnect_volume: return (364ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:56:17 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:56:18 user nova-compute[71364]: DEBUG nova.objects.instance [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lazy-loading 'flavor' on Instance uuid 906866ce-6f86-4036-8b39-76b3e7d7c1fb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.861s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "e627de16-3a8f-4510-8001-0e57a272b859" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:20 user nova-compute[71364]: INFO nova.compute.manager [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Detaching volume ea22c351-542d-46cf-b3c4-9dc459161758
Apr 11 21:56:20 user nova-compute[71364]: INFO nova.virt.block_device [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Attempting to driver detach volume ea22c351-542d-46cf-b3c4-9dc459161758 from mountpoint /dev/vdb
Apr 11 21:56:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Attempting to detach device vdb from instance e627de16-3a8f-4510-8001-0e57a272b859 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:56:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:56:20 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:56:20 user nova-compute[71364]:   <source dev="/dev/sde"/>
Apr 11 21:56:20 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:56:20 user nova-compute[71364]:   <serial>ea22c351-542d-46cf-b3c4-9dc459161758</serial>
Apr 11 21:56:20 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:56:20 user nova-compute[71364]: </disk>
Apr 11 21:56:20 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:56:20 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Successfully detached device vdb from instance e627de16-3a8f-4510-8001-0e57a272b859 from the persistent domain config.
Apr 11 21:56:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e627de16-3a8f-4510-8001-0e57a272b859 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:56:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:56:20 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:56:20 user nova-compute[71364]:   <source dev="/dev/sde"/>
Apr 11 21:56:20 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:56:20 user nova-compute[71364]:   <serial>ea22c351-542d-46cf-b3c4-9dc459161758</serial>
Apr 11 21:56:20 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 21:56:20 user nova-compute[71364]: </disk>
Apr 11 21:56:20 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681250181.0764225, e627de16-3a8f-4510-8001-0e57a272b859 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:56:21 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Successfully detached device vdb from instance e627de16-3a8f-4510-8001-0e57a272b859 from the live domain config.
Apr 11 21:56:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QGxMCIZV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:56:21 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e33678-0eb1-4f1b-98df-918d777e6163]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:56:21 user nova-compute[71364]: No targets found.
Apr 11 21:56:21 user nova-compute[71364]: iSNS:
Apr 11 21:56:21 user nova-compute[71364]: No targets found.
Apr 11 21:56:21 user nova-compute[71364]: STATIC:
Apr 11 21:56:21 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758
Apr 11 21:56:21 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:56:21 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:56:21 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44
Apr 11 21:56:21 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:56:21 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:56:21 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722
Apr 11 21:56:21 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:56:21 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:56:21 user nova-compute[71364]: FIRMWARE:
Apr 11 21:56:21 user nova-compute[71364]: No targets found.
Apr 11 21:56:21 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:56:21 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:56:21 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa16a07e-cec1-4f1c-a980-4c3b17d8b585]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eba9ed6-483e-4a12-8c4f-156c546f255d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:56:21 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:56:21 user nova-compute[71364]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:56:21 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 (non-flash)
Apr 11 21:56:21 user nova-compute[71364]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:56:21 user nova-compute[71364]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:56:21 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacc36b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758'): ({'sde'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Removing single pathed devices sde {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[079af749-2924-4896-b84e-8305dfddb19b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[61199e96-d280-4e61-8644-163ca5bdfb4f]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Flushing IO for device /dev/sde {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c206b11f-c26c-47d8-89bb-43906a39b6a8]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c5975d-7fc5-47c2-ae19-d3baa0f71f7e]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[567e64e3-7f7b-465c-9ea1-5d07016840e2]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eddc46-eef6-42eb-8d14-7680f22c54bc]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758, portal: 172.16.0.220,3260]
Apr 11 21:56:21 user nova-compute[71364]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758, portal: 172.16.0.220,3260] successful.
Apr 11 21:56:21 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea22c351-542d-46cf-b3c4-9dc459161758 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca4f506-52ab-4e15-9bdc-3acabdafe6c4]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] <== disconnect_volume: return (329ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:21 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250166.9869742, 71a04a77-49b8-4d4a-bc66-e233aa7eab08 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:56:21 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] VM Stopped (Lifecycle Event)
Apr 11 21:56:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0ea7e92d-36c0-4ea2-b81a-842d4419932c None None] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:56:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:22 user nova-compute[71364]: DEBUG nova.objects.instance [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'flavor' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "e627de16-3a8f-4510-8001-0e57a272b859" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.928s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 76315af2-c4b9-4ad5-98ea-81826524d63e {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 29e6c78a-dee0-4d28-86cd-debad15718d4 {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 906866ce-6f86-4036-8b39-76b3e7d7c1fb {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid b66951a9-73f3-41ce-9f19-b4e5e24d61b0 {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 3915859d-4e2f-4568-9b02-d0733a474749 {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "e627de16-3a8f-4510-8001-0e57a272b859" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "76315af2-c4b9-4ad5-98ea-81826524d63e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "29e6c78a-dee0-4d28-86cd-debad15718d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "3915859d-4e2f-4568-9b02-d0733a474749" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "e627de16-3a8f-4510-8001-0e57a272b859" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "3915859d-4e2f-4568-9b02-d0733a474749" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:27 user nova-compute[71364]: INFO nova.compute.manager [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Rescuing
Apr 11 21:56:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:56:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquired lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:56:27 user nova-compute[71364]: DEBUG nova.network.neutron [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:56:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:27 user nova-compute[71364]: DEBUG nova.network.neutron [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Updating instance_info_cache with network_info: [{"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:56:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Releasing lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:56:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.compute.manager [req-de307d60-b663-4500-a8cb-b9cc9bb6cb6c req-7a180e65-4f29-4fff-a775-53d3168120e9 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received event network-vif-unplugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-de307d60-b663-4500-a8cb-b9cc9bb6cb6c req-7a180e65-4f29-4fff-a775-53d3168120e9 service nova] Acquiring lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-de307d60-b663-4500-a8cb-b9cc9bb6cb6c req-7a180e65-4f29-4fff-a775-53d3168120e9 service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-de307d60-b663-4500-a8cb-b9cc9bb6cb6c req-7a180e65-4f29-4fff-a775-53d3168120e9 service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.compute.manager [req-de307d60-b663-4500-a8cb-b9cc9bb6cb6c req-7a180e65-4f29-4fff-a775-53d3168120e9 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] No waiting events found dispatching network-vif-unplugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:56:28 user nova-compute[71364]: WARNING nova.compute.manager [req-de307d60-b663-4500-a8cb-b9cc9bb6cb6c req-7a180e65-4f29-4fff-a775-53d3168120e9 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received unexpected event network-vif-unplugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance with vm_state active and task_state rescuing.
Apr 11 21:56:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:28 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Instance destroyed successfully.
Apr 11 21:56:28 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Attempting rescue
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71364) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Instance directory exists: not creating {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 21:56:28 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Creating image(s)
Apr 11 21:56:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "/opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "/opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "/opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.objects.instance [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'trusted_certs' on Instance uuid 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue" returned: 0 in 0.049s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.objects.instance [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'migration_context' on Instance uuid 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Start _get_guest_xml network_info=[{"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "vif_mac": "fa:16:3e:d3:96:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.objects.instance [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'resources' on Instance uuid 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.objects.instance [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'numa_topology' on Instance uuid 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:28 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:56:28 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.objects.instance [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1993933386',display_name='tempest-ServerRescueNegativeTestJSON-server-1993933386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1993933386',id=18,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:54:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c35707743988462887127e06825cd483',ramdisk_id='',reservation_id='r-05vqbj4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-797099247',owner_user_name='tempest-ServerRescueNegativeTestJSON-797099247-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:54:45Z,user_data=None,user_id='546f0a94a2ad450ead596252c786839e',uuid=76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "vif_mac": "fa:16:3e:d3:96:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converting VIF {"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "vif_mac": "fa:16:3e:d3:96:ef"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=03ff224c-ce46-4e9a-8eae-357d41acfef2,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ff224c-ce') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.objects.instance [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'pci_devices' on Instance uuid 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:56:28 user nova-compute[71364]:   <uuid>76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d</uuid>
Apr 11 21:56:28 user nova-compute[71364]:   <name>instance-00000012</name>
Apr 11 21:56:28 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:56:28 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:56:28 user nova-compute[71364]:   <metadata>
Apr 11 21:56:28 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:56:28 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:56:28 user nova-compute[71364]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1993933386</nova:name>
Apr 11 21:56:28 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:56:28</nova:creationTime>
Apr 11 21:56:28 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:56:28 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:56:28 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:56:28 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:56:28 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:56:28 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:56:28 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:56:28 user nova-compute[71364]:       <nova:owner>
Apr 11 21:56:28 user nova-compute[71364]:         <nova:user uuid="546f0a94a2ad450ead596252c786839e">tempest-ServerRescueNegativeTestJSON-797099247-project-member</nova:user>
Apr 11 21:56:28 user nova-compute[71364]:         <nova:project uuid="c35707743988462887127e06825cd483">tempest-ServerRescueNegativeTestJSON-797099247</nova:project>
Apr 11 21:56:28 user nova-compute[71364]:       </nova:owner>
Apr 11 21:56:28 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:56:28 user nova-compute[71364]:       <nova:ports>
Apr 11 21:56:28 user nova-compute[71364]:         <nova:port uuid="03ff224c-ce46-4e9a-8eae-357d41acfef2">
Apr 11 21:56:28 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 21:56:28 user nova-compute[71364]:         </nova:port>
Apr 11 21:56:28 user nova-compute[71364]:       </nova:ports>
Apr 11 21:56:28 user nova-compute[71364]:     </nova:instance>
Apr 11 21:56:28 user nova-compute[71364]:   </metadata>
Apr 11 21:56:28 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:56:28 user nova-compute[71364]:     <system>
Apr 11 21:56:28 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:56:28 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:56:28 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:56:28 user nova-compute[71364]:       <entry name="serial">76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d</entry>
Apr 11 21:56:28 user nova-compute[71364]:       <entry name="uuid">76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d</entry>
Apr 11 21:56:28 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:56:28 user nova-compute[71364]:     </system>
Apr 11 21:56:28 user nova-compute[71364]:   </sysinfo>
Apr 11 21:56:28 user nova-compute[71364]:   <os>
Apr 11 21:56:28 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:56:28 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:56:28 user nova-compute[71364]:   </os>
Apr 11 21:56:28 user nova-compute[71364]:   <features>
Apr 11 21:56:28 user nova-compute[71364]:     <acpi/>
Apr 11 21:56:28 user nova-compute[71364]:     <apic/>
Apr 11 21:56:28 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:56:28 user nova-compute[71364]:   </features>
Apr 11 21:56:28 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:56:28 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:56:28 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:56:28 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:56:28 user nova-compute[71364]:   </clock>
Apr 11 21:56:28 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:56:28 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:56:28 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:56:28 user nova-compute[71364]:   </cpu>
Apr 11 21:56:28 user nova-compute[71364]:   <devices>
Apr 11 21:56:28 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:56:28 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:56:28 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue"/>
Apr 11 21:56:28 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:56:28 user nova-compute[71364]:     </disk>
Apr 11 21:56:28 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:56:28 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:56:28 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk"/>
Apr 11 21:56:28 user nova-compute[71364]:       <target dev="vdb" bus="virtio"/>
Apr 11 21:56:28 user nova-compute[71364]:     </disk>
Apr 11 21:56:28 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:56:28 user nova-compute[71364]:       <mac address="fa:16:3e:d3:96:ef"/>
Apr 11 21:56:28 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:56:28 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:56:28 user nova-compute[71364]:       <target dev="tap03ff224c-ce"/>
Apr 11 21:56:28 user nova-compute[71364]:     </interface>
Apr 11 21:56:28 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:56:28 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/console.log" append="off"/>
Apr 11 21:56:28 user nova-compute[71364]:     </serial>
Apr 11 21:56:28 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:56:28 user nova-compute[71364]:     <video>
Apr 11 21:56:28 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:56:28 user nova-compute[71364]:     </video>
Apr 11 21:56:28 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:56:28 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:56:28 user nova-compute[71364]:     </rng>
Apr 11 21:56:28 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:56:28 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:56:28 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:56:28 user nova-compute[71364]:     </memballoon>
Apr 11 21:56:28 user nova-compute[71364]:   </devices>
Apr 11 21:56:28 user nova-compute[71364]: </domain>
Apr 11 21:56:28 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:56:28 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Instance destroyed successfully.
Apr 11 21:56:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:56:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No VIF found with MAC fa:16:3e:d3:96:ef, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:56:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-52694609-67f1-4db9-9a18-354d25d1cfd5 req-0dd3cbf9-5529-4213-a8db-aaef3918b3b0 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received event network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-52694609-67f1-4db9-9a18-354d25d1cfd5 req-0dd3cbf9-5529-4213-a8db-aaef3918b3b0 service nova] Acquiring lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-52694609-67f1-4db9-9a18-354d25d1cfd5 req-0dd3cbf9-5529-4213-a8db-aaef3918b3b0 service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-52694609-67f1-4db9-9a18-354d25d1cfd5 req-0dd3cbf9-5529-4213-a8db-aaef3918b3b0 service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-52694609-67f1-4db9-9a18-354d25d1cfd5 req-0dd3cbf9-5529-4213-a8db-aaef3918b3b0 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] No waiting events found dispatching network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:56:30 user nova-compute[71364]: WARNING nova.compute.manager [req-52694609-67f1-4db9-9a18-354d25d1cfd5 req-0dd3cbf9-5529-4213-a8db-aaef3918b3b0 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received unexpected event network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance with vm_state active and task_state rescuing.
Apr 11 21:56:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received event network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] Acquiring lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] No waiting events found dispatching network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:56:32 user nova-compute[71364]: WARNING nova.compute.manager [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received unexpected event network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance with vm_state active and task_state rescuing.
Apr 11 21:56:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received event network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] Acquiring lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] No waiting events found dispatching network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:56:32 user nova-compute[71364]: WARNING nova.compute.manager [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received unexpected event network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance with vm_state active and task_state rescuing.
Apr 11 21:56:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 21:56:32 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250192.4290159, 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:56:32 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] VM Resumed (Lifecycle Event)
Apr 11 21:56:32 user nova-compute[71364]: DEBUG nova.compute.manager [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:56:32 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:56:32 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:56:32 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 21:56:32 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250192.4335008, 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:56:32 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] VM Started (Lifecycle Event)
Apr 11 21:56:32 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:56:32 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:56:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:56:36 user nova-compute[71364]: INFO nova.compute.claims [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Claim successful on node user
Apr 11 21:56:36 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG nova.network.neutron [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:56:36 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:56:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG nova.policy [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:56:36 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Creating image(s)
Apr 11 21:56:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "/opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "/opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk 1073741824" returned: 0 in 0.044s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Cannot resize image /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG nova.objects.instance [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'migration_context' on Instance uuid cc39cc0e-7829-408b-8477-0c57d8bfa2c5 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Ensure instance console log exists: /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:37 user nova-compute[71364]: DEBUG nova.network.neutron [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Successfully created port: 2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Successfully updated port: 2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "refresh_cache-cc39cc0e-7829-408b-8477-0c57d8bfa2c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquired lock "refresh_cache-cc39cc0e-7829-408b-8477-0c57d8bfa2c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.compute.manager [req-d8cc3dda-3883-4a0e-a098-aeca7b72f34d req-86f0f5fd-312a-483d-b809-744e995b1afc service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received event network-changed-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.compute.manager [req-d8cc3dda-3883-4a0e-a098-aeca7b72f34d req-86f0f5fd-312a-483d-b809-744e995b1afc service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Refreshing instance network info cache due to event network-changed-2d06f000-3612-4f47-8d55-fcd6a395edd4. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d8cc3dda-3883-4a0e-a098-aeca7b72f34d req-86f0f5fd-312a-483d-b809-744e995b1afc service nova] Acquiring lock "refresh_cache-cc39cc0e-7829-408b-8477-0c57d8bfa2c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Updating instance_info_cache with network_info: [{"id": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "address": "fa:16:3e:7d:db:0d", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d06f000-36", "ovs_interfaceid": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Releasing lock "refresh_cache-cc39cc0e-7829-408b-8477-0c57d8bfa2c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Instance network_info: |[{"id": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "address": "fa:16:3e:7d:db:0d", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d06f000-36", "ovs_interfaceid": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d8cc3dda-3883-4a0e-a098-aeca7b72f34d req-86f0f5fd-312a-483d-b809-744e995b1afc service nova] Acquired lock "refresh_cache-cc39cc0e-7829-408b-8477-0c57d8bfa2c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.network.neutron [req-d8cc3dda-3883-4a0e-a098-aeca7b72f34d req-86f0f5fd-312a-483d-b809-744e995b1afc service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Refreshing network info cache for port 2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Start _get_guest_xml network_info=[{"id": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "address": "fa:16:3e:7d:db:0d", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d06f000-36", "ovs_interfaceid": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:56:38 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:56:38 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-595669330',display_name='tempest-AttachVolumeNegativeTest-server-595669330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-595669330',id=20,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz6mVMcT7TPTvnXw3zpX6cwXXyxar3QiaeczH68jSUuYR+MPNxtKZQvzYhSjWr+4ocLH7glsVk11JQLeOTc0UEw0OqaKeyfGTa6OCbXNYfa7N0mGhKuFFLIvEsAOe8gtw==',key_name='tempest-keypair-861149349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='722a2704f607415ebe42af5ad98bf419',ramdisk_id='',reservation_id='r-w500xaei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2131251711',owner_user_name='tempest-AttachVolumeNegativeTest-2131251711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:56:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d615e85afb4354b37e88b5a24429d8',uuid=cc39cc0e-7829-408b-8477-0c57d8bfa2c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "address": "fa:16:3e:7d:db:0d", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d06f000-36", "ovs_interfaceid": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converting VIF {"id": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "address": "fa:16:3e:7d:db:0d", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d06f000-36", "ovs_interfaceid": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:db:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d06f000-3612-4f47-8d55-fcd6a395edd4,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d06f000-36') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.objects.instance [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'pci_devices' on Instance uuid cc39cc0e-7829-408b-8477-0c57d8bfa2c5 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:56:38 user nova-compute[71364]:   <uuid>cc39cc0e-7829-408b-8477-0c57d8bfa2c5</uuid>
Apr 11 21:56:38 user nova-compute[71364]:   <name>instance-00000014</name>
Apr 11 21:56:38 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:56:38 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:56:38 user nova-compute[71364]:   <metadata>
Apr 11 21:56:38 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:56:38 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:56:38 user nova-compute[71364]:       <nova:name>tempest-AttachVolumeNegativeTest-server-595669330</nova:name>
Apr 11 21:56:38 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:56:38</nova:creationTime>
Apr 11 21:56:38 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:56:38 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:56:38 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:56:38 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:56:38 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:56:38 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:56:38 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:56:38 user nova-compute[71364]:       <nova:owner>
Apr 11 21:56:38 user nova-compute[71364]:         <nova:user uuid="b6d615e85afb4354b37e88b5a24429d8">tempest-AttachVolumeNegativeTest-2131251711-project-member</nova:user>
Apr 11 21:56:38 user nova-compute[71364]:         <nova:project uuid="722a2704f607415ebe42af5ad98bf419">tempest-AttachVolumeNegativeTest-2131251711</nova:project>
Apr 11 21:56:38 user nova-compute[71364]:       </nova:owner>
Apr 11 21:56:38 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:56:38 user nova-compute[71364]:       <nova:ports>
Apr 11 21:56:38 user nova-compute[71364]:         <nova:port uuid="2d06f000-3612-4f47-8d55-fcd6a395edd4">
Apr 11 21:56:38 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 11 21:56:38 user nova-compute[71364]:         </nova:port>
Apr 11 21:56:38 user nova-compute[71364]:       </nova:ports>
Apr 11 21:56:38 user nova-compute[71364]:     </nova:instance>
Apr 11 21:56:38 user nova-compute[71364]:   </metadata>
Apr 11 21:56:38 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:56:38 user nova-compute[71364]:     <system>
Apr 11 21:56:38 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:56:38 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:56:38 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:56:38 user nova-compute[71364]:       <entry name="serial">cc39cc0e-7829-408b-8477-0c57d8bfa2c5</entry>
Apr 11 21:56:38 user nova-compute[71364]:       <entry name="uuid">cc39cc0e-7829-408b-8477-0c57d8bfa2c5</entry>
Apr 11 21:56:38 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:56:38 user nova-compute[71364]:     </system>
Apr 11 21:56:38 user nova-compute[71364]:   </sysinfo>
Apr 11 21:56:38 user nova-compute[71364]:   <os>
Apr 11 21:56:38 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:56:38 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:56:38 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:56:38 user nova-compute[71364]:   </os>
Apr 11 21:56:38 user nova-compute[71364]:   <features>
Apr 11 21:56:38 user nova-compute[71364]:     <acpi/>
Apr 11 21:56:38 user nova-compute[71364]:     <apic/>
Apr 11 21:56:38 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:56:38 user nova-compute[71364]:   </features>
Apr 11 21:56:38 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:56:38 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:56:38 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:56:38 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:56:38 user nova-compute[71364]:   </clock>
Apr 11 21:56:38 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:56:38 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:56:38 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:56:38 user nova-compute[71364]:   </cpu>
Apr 11 21:56:38 user nova-compute[71364]:   <devices>
Apr 11 21:56:38 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:56:38 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:56:38 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk"/>
Apr 11 21:56:38 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:56:38 user nova-compute[71364]:     </disk>
Apr 11 21:56:38 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:56:38 user nova-compute[71364]:       <mac address="fa:16:3e:7d:db:0d"/>
Apr 11 21:56:38 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:56:38 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:56:38 user nova-compute[71364]:       <target dev="tap2d06f000-36"/>
Apr 11 21:56:38 user nova-compute[71364]:     </interface>
Apr 11 21:56:38 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:56:38 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/console.log" append="off"/>
Apr 11 21:56:38 user nova-compute[71364]:     </serial>
Apr 11 21:56:38 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:56:38 user nova-compute[71364]:     <video>
Apr 11 21:56:38 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:56:38 user nova-compute[71364]:     </video>
Apr 11 21:56:38 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:56:38 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:56:38 user nova-compute[71364]:     </rng>
Apr 11 21:56:38 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:56:38 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:56:38 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:56:38 user nova-compute[71364]:     </memballoon>
Apr 11 21:56:38 user nova-compute[71364]:   </devices>
Apr 11 21:56:38 user nova-compute[71364]: </domain>
Apr 11 21:56:38 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-595669330',display_name='tempest-AttachVolumeNegativeTest-server-595669330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-595669330',id=20,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz6mVMcT7TPTvnXw3zpX6cwXXyxar3QiaeczH68jSUuYR+MPNxtKZQvzYhSjWr+4ocLH7glsVk11JQLeOTc0UEw0OqaKeyfGTa6OCbXNYfa7N0mGhKuFFLIvEsAOe8gtw==',key_name='tempest-keypair-861149349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='722a2704f607415ebe42af5ad98bf419',ramdisk_id='',reservation_id='r-w500xaei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2131251711',owner_user_name='tempest-AttachVolumeNegativeTest-2131251711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:56:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d615e85afb4354b37e88b5a24429d8',uuid=cc39cc0e-7829-408b-8477-0c57d8bfa2c5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "address": "fa:16:3e:7d:db:0d", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d06f000-36", "ovs_interfaceid": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converting VIF {"id": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "address": "fa:16:3e:7d:db:0d", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d06f000-36", "ovs_interfaceid": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:db:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d06f000-3612-4f47-8d55-fcd6a395edd4,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d06f000-36') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG os_vif [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:db:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d06f000-3612-4f47-8d55-fcd6a395edd4,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d06f000-36') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d06f000-36, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d06f000-36, col_values=(('external_ids', {'iface-id': '2d06f000-3612-4f47-8d55-fcd6a395edd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:db:0d', 'vm-uuid': 'cc39cc0e-7829-408b-8477-0c57d8bfa2c5'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:38 user nova-compute[71364]: INFO os_vif [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:db:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d06f000-3612-4f47-8d55-fcd6a395edd4,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d06f000-36')
Apr 11 21:56:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:56:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No VIF found with MAC fa:16:3e:7d:db:0d, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:56:39 user nova-compute[71364]: DEBUG nova.network.neutron [req-d8cc3dda-3883-4a0e-a098-aeca7b72f34d req-86f0f5fd-312a-483d-b809-744e995b1afc service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Updated VIF entry in instance network info cache for port 2d06f000-3612-4f47-8d55-fcd6a395edd4. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:56:39 user nova-compute[71364]: DEBUG nova.network.neutron [req-d8cc3dda-3883-4a0e-a098-aeca7b72f34d req-86f0f5fd-312a-483d-b809-744e995b1afc service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Updating instance_info_cache with network_info: [{"id": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "address": "fa:16:3e:7d:db:0d", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d06f000-36", "ovs_interfaceid": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:56:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d8cc3dda-3883-4a0e-a098-aeca7b72f34d req-86f0f5fd-312a-483d-b809-744e995b1afc service nova] Releasing lock "refresh_cache-cc39cc0e-7829-408b-8477-0c57d8bfa2c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:56:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:40 user nova-compute[71364]: DEBUG nova.compute.manager [req-d0c07dc9-0e2c-4844-a04b-a857f8878837 req-4bab6eb2-bd9d-454f-8304-bd8cb63f22d6 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received event network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d0c07dc9-0e2c-4844-a04b-a857f8878837 req-4bab6eb2-bd9d-454f-8304-bd8cb63f22d6 service nova] Acquiring lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d0c07dc9-0e2c-4844-a04b-a857f8878837 req-4bab6eb2-bd9d-454f-8304-bd8cb63f22d6 service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d0c07dc9-0e2c-4844-a04b-a857f8878837 req-4bab6eb2-bd9d-454f-8304-bd8cb63f22d6 service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:40 user nova-compute[71364]: DEBUG nova.compute.manager [req-d0c07dc9-0e2c-4844-a04b-a857f8878837 req-4bab6eb2-bd9d-454f-8304-bd8cb63f22d6 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] No waiting events found dispatching network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:56:40 user nova-compute[71364]: WARNING nova.compute.manager [req-d0c07dc9-0e2c-4844-a04b-a857f8878837 req-4bab6eb2-bd9d-454f-8304-bd8cb63f22d6 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received unexpected event network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance with vm_state building and task_state spawning.
Apr 11 21:56:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250202.4330845, cc39cc0e-7829-408b-8477-0c57d8bfa2c5 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:56:42 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] VM Resumed (Lifecycle Event)
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:56:42 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Instance spawned successfully.
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:56:42 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250202.4351094, cc39cc0e-7829-408b-8477-0c57d8bfa2c5 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:56:42 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] VM Started (Lifecycle Event)
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:56:42 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:56:42 user nova-compute[71364]: INFO nova.compute.manager [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Took 5.60 seconds to spawn the instance on the hypervisor.
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-1fd29d39-4d1b-4308-b1d8-79e8f4e82ef8 req-0afc45de-3b80-42dd-8562-4a9f9b9c0cfe service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received event network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1fd29d39-4d1b-4308-b1d8-79e8f4e82ef8 req-0afc45de-3b80-42dd-8562-4a9f9b9c0cfe service nova] Acquiring lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1fd29d39-4d1b-4308-b1d8-79e8f4e82ef8 req-0afc45de-3b80-42dd-8562-4a9f9b9c0cfe service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1fd29d39-4d1b-4308-b1d8-79e8f4e82ef8 req-0afc45de-3b80-42dd-8562-4a9f9b9c0cfe service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-1fd29d39-4d1b-4308-b1d8-79e8f4e82ef8 req-0afc45de-3b80-42dd-8562-4a9f9b9c0cfe service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] No waiting events found dispatching network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:56:42 user nova-compute[71364]: WARNING nova.compute.manager [req-1fd29d39-4d1b-4308-b1d8-79e8f4e82ef8 req-0afc45de-3b80-42dd-8562-4a9f9b9c0cfe service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received unexpected event network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance with vm_state building and task_state spawning.
Apr 11 21:56:42 user nova-compute[71364]: INFO nova.compute.manager [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Took 6.36 seconds to build instance.
Apr 11 21:56:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.459s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:49 user nova-compute[71364]: INFO nova.compute.manager [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Detaching volume 7f857075-bc19-44dc-a51d-42eec7e86722
Apr 11 21:56:49 user nova-compute[71364]: INFO nova.virt.block_device [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Attempting to driver detach volume 7f857075-bc19-44dc-a51d-42eec7e86722 from mountpoint /dev/vdb
Apr 11 21:56:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Attempting to detach device vdb from instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 21:56:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:56:49 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:56:49 user nova-compute[71364]:   <source dev="/dev/sdf"/>
Apr 11 21:56:49 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:56:49 user nova-compute[71364]:   <serial>7f857075-bc19-44dc-a51d-42eec7e86722</serial>
Apr 11 21:56:49 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 21:56:49 user nova-compute[71364]: </disk>
Apr 11 21:56:49 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:56:49 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully detached device vdb from instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb from the persistent domain config.
Apr 11 21:56:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 21:56:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 21:56:49 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:56:49 user nova-compute[71364]:   <source dev="/dev/sdf"/>
Apr 11 21:56:49 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:56:49 user nova-compute[71364]:   <serial>7f857075-bc19-44dc-a51d-42eec7e86722</serial>
Apr 11 21:56:49 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 21:56:49 user nova-compute[71364]: </disk>
Apr 11 21:56:49 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681250210.4209745, 5ff9bbaf-1a5e-4acd-aca3-d956728312cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 21:56:50 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully detached device vdb from instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb from the live domain config.
Apr 11 21:56:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHfSpTKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:56:50 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6f089e-c833-48cf-b325-df6b74d74843]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:56:50 user nova-compute[71364]: No targets found.
Apr 11 21:56:50 user nova-compute[71364]: iSNS:
Apr 11 21:56:50 user nova-compute[71364]: No targets found.
Apr 11 21:56:50 user nova-compute[71364]: STATIC:
Apr 11 21:56:50 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44
Apr 11 21:56:50 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:56:50 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:56:50 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722
Apr 11 21:56:50 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:56:50 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:56:50 user nova-compute[71364]: FIRMWARE:
Apr 11 21:56:50 user nova-compute[71364]: No targets found.
Apr 11 21:56:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:56:50 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:56:50 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb072cad-adb4-4f9d-9689-276310f49459]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fa6d8f-4b54-4551-abf6-575cf451091a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:56:50 user nova-compute[71364]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:56:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 (non-flash)
Apr 11 21:56:50 user nova-compute[71364]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:56:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bf02bc4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722'): ({'sdf'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Removing single pathed devices sdf {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8f5f58-0326-474d-ae76-e770b70a2781]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e9fe30-71bd-47b0-806f-4b70105ea05c]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flushing IO for device /dev/sdf {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7d5743-4e0a-41e5-b1f4-2abd8b2b2e98]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6307a34a-f164-43dc-9de4-151743bb9f2a]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] SCSI volumes sdf have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e741ac4-0517-4987-ad4c-8c92d16f92db]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25fadb0-80a2-4a19-8576-d62d38719899]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260]
Apr 11 21:56:50 user nova-compute[71364]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722, portal: 172.16.0.220,3260] successful.
Apr 11 21:56:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f857075-bc19-44dc-a51d-42eec7e86722 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e95b56a-f87d-4ab7-b8be-bb13c4c15d7b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== disconnect_volume: return (313ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:56:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:56:51 user nova-compute[71364]: DEBUG nova.objects.instance [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'flavor' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.779s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:56:55 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:56:55 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7466MB free_disk=26.172794342041016GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance e627de16-3a8f-4510-8001-0e57a272b859 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76315af2-c4b9-4ad5-98ea-81826524d63e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3915859d-4e2f-4568-9b02-d0733a474749 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:56:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:56:56 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:56:56 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:56:56 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 21:56:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-514f5cac-9b1d-42e9-9619-0a2ce6c82b14" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:56:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-514f5cac-9b1d-42e9-9619-0a2ce6c82b14" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:56:57 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:56:57 user nova-compute[71364]: DEBUG nova.objects.instance [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lazy-loading 'info_cache' on Instance uuid 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:56:57 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Updating instance_info_cache with network_info: [{"id": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "address": "fa:16:3e:85:6d:26", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34feb75-3b", "ovs_interfaceid": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:56:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-514f5cac-9b1d-42e9-9619-0a2ce6c82b14" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:56:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:56:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:56:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:56:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:56:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:56:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:56:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:56:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:56:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:56:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-59a61e7e-3d9a-47d0-9724-b565a50d8372 req-d3acf9dc-6aa4-4364-b460-6c3c2b51cd1e service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Received event network-changed-bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-59a61e7e-3d9a-47d0-9724-b565a50d8372 req-d3acf9dc-6aa4-4364-b460-6c3c2b51cd1e service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Refreshing instance network info cache due to event network-changed-bfd12cce-c416-4b40-a9f4-323c2de32995. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59a61e7e-3d9a-47d0-9724-b565a50d8372 req-d3acf9dc-6aa4-4364-b460-6c3c2b51cd1e service nova] Acquiring lock "refresh_cache-906866ce-6f86-4036-8b39-76b3e7d7c1fb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59a61e7e-3d9a-47d0-9724-b565a50d8372 req-d3acf9dc-6aa4-4364-b460-6c3c2b51cd1e service nova] Acquired lock "refresh_cache-906866ce-6f86-4036-8b39-76b3e7d7c1fb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG nova.network.neutron [req-59a61e7e-3d9a-47d0-9724-b565a50d8372 req-d3acf9dc-6aa4-4364-b460-6c3c2b51cd1e service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Refreshing network info cache for port bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:08 user nova-compute[71364]: INFO nova.compute.manager [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Terminating instance
Apr 11 21:57:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG nova.network.neutron [req-59a61e7e-3d9a-47d0-9724-b565a50d8372 req-d3acf9dc-6aa4-4364-b460-6c3c2b51cd1e service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Updated VIF entry in instance network info cache for port bfd12cce-c416-4b40-a9f4-323c2de32995. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG nova.network.neutron [req-59a61e7e-3d9a-47d0-9724-b565a50d8372 req-d3acf9dc-6aa4-4364-b460-6c3c2b51cd1e service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Updating instance_info_cache with network_info: [{"id": "bfd12cce-c416-4b40-a9f4-323c2de32995", "address": "fa:16:3e:7f:95:3a", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd12cce-c4", "ovs_interfaceid": "bfd12cce-c416-4b40-a9f4-323c2de32995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59a61e7e-3d9a-47d0-9724-b565a50d8372 req-d3acf9dc-6aa4-4364-b460-6c3c2b51cd1e service nova] Releasing lock "refresh_cache-906866ce-6f86-4036-8b39-76b3e7d7c1fb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-1ccc4698-1b57-43a3-978e-ad8c7d25b74e req-c023fecc-2cce-47cb-a747-4f29bd313730 service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Received event network-vif-unplugged-bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ccc4698-1b57-43a3-978e-ad8c7d25b74e req-c023fecc-2cce-47cb-a747-4f29bd313730 service nova] Acquiring lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ccc4698-1b57-43a3-978e-ad8c7d25b74e req-c023fecc-2cce-47cb-a747-4f29bd313730 service nova] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ccc4698-1b57-43a3-978e-ad8c7d25b74e req-c023fecc-2cce-47cb-a747-4f29bd313730 service nova] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-1ccc4698-1b57-43a3-978e-ad8c7d25b74e req-c023fecc-2cce-47cb-a747-4f29bd313730 service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] No waiting events found dispatching network-vif-unplugged-bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-1ccc4698-1b57-43a3-978e-ad8c7d25b74e req-c023fecc-2cce-47cb-a747-4f29bd313730 service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Received event network-vif-unplugged-bfd12cce-c416-4b40-a9f4-323c2de32995 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:57:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:09 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Instance destroyed successfully.
Apr 11 21:57:09 user nova-compute[71364]: DEBUG nova.objects.instance [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lazy-loading 'resources' on Instance uuid 906866ce-6f86-4036-8b39-76b3e7d7c1fb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:57:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-87720805',display_name='tempest-TestStampPattern-server-87720805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-87720805',id=16,image_ref='be1b20e5-21d3-485f-9a0a-df2097538037',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpCRhqzUB7FAJyPBKJlCQG79NsEN1MlKiYeS6HxcdWPP0UKr1248UxMjqeqQ05u0XR5/7y/57d+iYThyqW9HhypiFf/4Et50oE3GriCFvwstOcaJA+DGlCD4+QUkbFCBA==',key_name='tempest-TestStampPattern-1506752109',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:54:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8df5d7d74644c8bb2f768e9a871f75c',ramdisk_id='',reservation_id='r-3cc0e0t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='76315af2-c4b9-4ad5-98ea-81826524d63e',image_min_disk='1',image_min_ram='0',image_owner_id='b8df5d7d74644c8bb2f768e9a871f75c',image_owner_project_name='tempest-TestStampPattern-1188732380',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1188732380-project-member',image_user_id='1aeabb5e8b4b463e8481e4ae8ecc1153',owner_project_name='tempest-TestStampPattern-1188732380',owner_user_name='tempest-TestStampPattern-1188732380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:54:24Z,user_data=None,user_id='1aeabb5e8b4b463e8481e4ae8ecc1153',uuid=906866ce-6f86-4036-8b39-76b3e7d7c1fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfd12cce-c416-4b40-a9f4-323c2de32995", "address": "fa:16:3e:7f:95:3a", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd12cce-c4", "ovs_interfaceid": "bfd12cce-c416-4b40-a9f4-323c2de32995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:57:09 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Converting VIF {"id": "bfd12cce-c416-4b40-a9f4-323c2de32995", "address": "fa:16:3e:7f:95:3a", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfd12cce-c4", "ovs_interfaceid": "bfd12cce-c416-4b40-a9f4-323c2de32995", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:57:09 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:95:3a,bridge_name='br-int',has_traffic_filtering=True,id=bfd12cce-c416-4b40-a9f4-323c2de32995,network=Network(ba787967-1d37-4f5f-8a91-3e720641c16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd12cce-c4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:57:09 user nova-compute[71364]: DEBUG os_vif [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:95:3a,bridge_name='br-int',has_traffic_filtering=True,id=bfd12cce-c416-4b40-a9f4-323c2de32995,network=Network(ba787967-1d37-4f5f-8a91-3e720641c16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd12cce-c4') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:57:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfd12cce-c4, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:57:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:57:09 user nova-compute[71364]: INFO os_vif [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:95:3a,bridge_name='br-int',has_traffic_filtering=True,id=bfd12cce-c416-4b40-a9f4-323c2de32995,network=Network(ba787967-1d37-4f5f-8a91-3e720641c16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfd12cce-c4')
Apr 11 21:57:09 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Deleting instance files /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb_del
Apr 11 21:57:09 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Deletion of /opt/stack/data/nova/instances/906866ce-6f86-4036-8b39-76b3e7d7c1fb_del complete
Apr 11 21:57:09 user nova-compute[71364]: INFO nova.compute.manager [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 11 21:57:09 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:57:09 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:57:09 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:57:09 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:57:09 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Took 0.57 seconds to deallocate network for instance.
Apr 11 21:57:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:10 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:57:10 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:57:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:10 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Deleted allocations for instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb
Apr 11 21:57:10 user nova-compute[71364]: DEBUG nova.compute.manager [req-57d37980-7721-4b02-8c97-339f6ce0a4d3 req-c481a1f3-cfa0-46cd-80b5-24bb586d16bb service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Received event network-vif-deleted-bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.987s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:10 user nova-compute[71364]: DEBUG nova.compute.manager [req-b4ae9637-a2e2-40c4-910d-2ab99ca222c8 req-a195c95b-551e-4502-84c3-e0a22bcba44f service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Received event network-vif-plugged-bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b4ae9637-a2e2-40c4-910d-2ab99ca222c8 req-a195c95b-551e-4502-84c3-e0a22bcba44f service nova] Acquiring lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b4ae9637-a2e2-40c4-910d-2ab99ca222c8 req-a195c95b-551e-4502-84c3-e0a22bcba44f service nova] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b4ae9637-a2e2-40c4-910d-2ab99ca222c8 req-a195c95b-551e-4502-84c3-e0a22bcba44f service nova] Lock "906866ce-6f86-4036-8b39-76b3e7d7c1fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:10 user nova-compute[71364]: DEBUG nova.compute.manager [req-b4ae9637-a2e2-40c4-910d-2ab99ca222c8 req-a195c95b-551e-4502-84c3-e0a22bcba44f service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] No waiting events found dispatching network-vif-plugged-bfd12cce-c416-4b40-a9f4-323c2de32995 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:57:10 user nova-compute[71364]: WARNING nova.compute.manager [req-b4ae9637-a2e2-40c4-910d-2ab99ca222c8 req-a195c95b-551e-4502-84c3-e0a22bcba44f service nova] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Received unexpected event network-vif-plugged-bfd12cce-c416-4b40-a9f4-323c2de32995 for instance with vm_state deleted and task_state None.
Apr 11 21:57:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:11 user nova-compute[71364]: DEBUG nova.compute.manager [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:57:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:11 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:57:11 user nova-compute[71364]: INFO nova.compute.claims [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Claim successful on node user
Apr 11 21:57:11 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:57:11 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:57:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:11 user nova-compute[71364]: DEBUG nova.compute.manager [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:57:11 user nova-compute[71364]: DEBUG nova.compute.manager [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:57:11 user nova-compute[71364]: DEBUG nova.network.neutron [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:57:11 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:57:11 user nova-compute[71364]: DEBUG nova.compute.manager [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:57:12 user nova-compute[71364]: DEBUG nova.policy [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:57:12 user nova-compute[71364]: INFO nova.virt.block_device [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Booting with blank volume at /dev/vda
Apr 11 21:57:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG nova.network.neutron [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Successfully created port: 8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "e627de16-3a8f-4510-8001-0e57a272b859" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:13 user nova-compute[71364]: INFO nova.compute.manager [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Terminating instance
Apr 11 21:57:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-52148ce6-6fea-431b-b8e7-395165c837bd req-22bc293e-cb58-4a61-91a7-4794e17f1e1b service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-vif-unplugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-52148ce6-6fea-431b-b8e7-395165c837bd req-22bc293e-cb58-4a61-91a7-4794e17f1e1b service nova] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-52148ce6-6fea-431b-b8e7-395165c837bd req-22bc293e-cb58-4a61-91a7-4794e17f1e1b service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-52148ce6-6fea-431b-b8e7-395165c837bd req-22bc293e-cb58-4a61-91a7-4794e17f1e1b service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-52148ce6-6fea-431b-b8e7-395165c837bd req-22bc293e-cb58-4a61-91a7-4794e17f1e1b service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] No waiting events found dispatching network-vif-unplugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-52148ce6-6fea-431b-b8e7-395165c837bd req-22bc293e-cb58-4a61-91a7-4794e17f1e1b service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-vif-unplugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:57:13 user nova-compute[71364]: DEBUG nova.network.neutron [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Successfully updated port: 8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquired lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG nova.compute.manager [req-f3320863-952c-46fb-b7ae-4ddc00821cf8 req-7a9f9eb2-6d27-4535-8f6d-3e666dfde6fc service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-changed-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG nova.compute.manager [req-f3320863-952c-46fb-b7ae-4ddc00821cf8 req-7a9f9eb2-6d27-4535-8f6d-3e666dfde6fc service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Refreshing instance network info cache due to event network-changed-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f3320863-952c-46fb-b7ae-4ddc00821cf8 req-7a9f9eb2-6d27-4535-8f6d-3e666dfde6fc service nova] Acquiring lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:14 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Instance destroyed successfully.
Apr 11 21:57:14 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'resources' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-405286600',display_name='tempest-ServerStableDeviceRescueTest-server-405286600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-405286600',id=3,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8UEH6m5UnzB3x3GKZuWdKxk/7Mog1k30VHYME5xmsB2oMV/EGVRbZfXe3hxruVI/c3+NH5gZP1pkgcqm0HyGY2eX0pPoQEeEsvHRlFY/LgN3qSuIuwhuAHFHFnkPGb1w==',key_name='tempest-keypair-301380016',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:54:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2a0320bbd424d039ac56f377f51132d',ramdisk_id='',reservation_id='r-qbwexep8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1504592746',owner_user_name='tempest-ServerStableDeviceRescueTest-1504592746-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:55:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='176bb0cf6ea849bfbe97f8275ec2f932',uuid=e627de16-3a8f-4510-8001-0e57a272b859,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Converting VIF {"id": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "address": "fa:16:3e:3e:1d:93", "network": {"id": "a9945e2c-fe10-4952-83c1-81f938544bce", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1853393007-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2a0320bbd424d039ac56f377f51132d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20b9e448-55", "ovs_interfaceid": "20b9e448-55b1-49a6-8c39-08b2ab9755eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:93,bridge_name='br-int',has_traffic_filtering=True,id=20b9e448-55b1-49a6-8c39-08b2ab9755eb,network=Network(a9945e2c-fe10-4952-83c1-81f938544bce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b9e448-55') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG os_vif [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:93,bridge_name='br-int',has_traffic_filtering=True,id=20b9e448-55b1-49a6-8c39-08b2ab9755eb,network=Network(a9945e2c-fe10-4952-83c1-81f938544bce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b9e448-55') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20b9e448-55, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:57:14 user nova-compute[71364]: INFO os_vif [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:1d:93,bridge_name='br-int',has_traffic_filtering=True,id=20b9e448-55b1-49a6-8c39-08b2ab9755eb,network=Network(a9945e2c-fe10-4952-83c1-81f938544bce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20b9e448-55')
Apr 11 21:57:14 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Deleting instance files /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859_del
Apr 11 21:57:14 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Deletion of /opt/stack/data/nova/instances/e627de16-3a8f-4510-8001-0e57a272b859_del complete
Apr 11 21:57:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Updating instance_info_cache with network_info: [{"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:57:14 user nova-compute[71364]: INFO nova.compute.manager [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 21:57:14 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: e627de16-3a8f-4510-8001-0e57a272b859] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Releasing lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Instance network_info: |[{"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f3320863-952c-46fb-b7ae-4ddc00821cf8 req-7a9f9eb2-6d27-4535-8f6d-3e666dfde6fc service nova] Acquired lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:57:14 user nova-compute[71364]: DEBUG nova.network.neutron [req-f3320863-952c-46fb-b7ae-4ddc00821cf8 req-7a9f9eb2-6d27-4535-8f6d-3e666dfde6fc service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Refreshing network info cache for port 8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:57:15 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Took 0.69 seconds to deallocate network for instance.
Apr 11 21:57:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG nova.network.neutron [req-f3320863-952c-46fb-b7ae-4ddc00821cf8 req-7a9f9eb2-6d27-4535-8f6d-3e666dfde6fc service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Updated VIF entry in instance network info cache for port 8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG nova.network.neutron [req-f3320863-952c-46fb-b7ae-4ddc00821cf8 req-7a9f9eb2-6d27-4535-8f6d-3e666dfde6fc service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Updating instance_info_cache with network_info: [{"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f3320863-952c-46fb-b7ae-4ddc00821cf8 req-7a9f9eb2-6d27-4535-8f6d-3e666dfde6fc service nova] Releasing lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:15 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Deleted allocations for instance e627de16-3a8f-4510-8001-0e57a272b859
Apr 11 21:57:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "e627de16-3a8f-4510-8001-0e57a272b859" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.074s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "9486ebab-256f-4804-8951-c29abca195b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "9486ebab-256f-4804-8951-c29abca195b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:57:15 user nova-compute[71364]: INFO nova.compute.claims [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Claim successful on node user
Apr 11 21:57:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-5fcad63a-128b-472c-9cc5-5306d6d635c1 req-16aceca4-152c-4a26-8851-6e4368d61d80 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5fcad63a-128b-472c-9cc5-5306d6d635c1 req-16aceca4-152c-4a26-8851-6e4368d61d80 service nova] Acquiring lock "e627de16-3a8f-4510-8001-0e57a272b859-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5fcad63a-128b-472c-9cc5-5306d6d635c1 req-16aceca4-152c-4a26-8851-6e4368d61d80 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5fcad63a-128b-472c-9cc5-5306d6d635c1 req-16aceca4-152c-4a26-8851-6e4368d61d80 service nova] Lock "e627de16-3a8f-4510-8001-0e57a272b859-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-5fcad63a-128b-472c-9cc5-5306d6d635c1 req-16aceca4-152c-4a26-8851-6e4368d61d80 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] No waiting events found dispatching network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:57:15 user nova-compute[71364]: WARNING nova.compute.manager [req-5fcad63a-128b-472c-9cc5-5306d6d635c1 req-16aceca4-152c-4a26-8851-6e4368d61d80 service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received unexpected event network-vif-plugged-20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance with vm_state deleted and task_state None.
Apr 11 21:57:16 user nova-compute[71364]: DEBUG nova.compute.manager [req-9ecff87c-e739-45d4-8de5-490c9fa5411d req-b5fc88d4-618d-458a-b7c2-05b55849e59a service nova] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Received event network-vif-deleted-20b9e448-55b1-49a6-8c39-08b2ab9755eb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG nova.network.neutron [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:16 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:57:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:57:16 user nova-compute[71364]: INFO nova.compute.claims [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Claim successful on node user
Apr 11 21:57:16 user nova-compute[71364]: DEBUG nova.policy [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b5df01d8bd0454f8ea96a5cdfe0df42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0294841cf2b746d3880854c2570a3657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:57:16 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Creating image(s)
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "/opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "/opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "/opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk 1073741824" returned: 0 in 0.047s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.compute.manager [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.compute.manager [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.network.neutron [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:57:17 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Cannot resize image /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.objects.instance [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lazy-loading 'migration_context' on Instance uuid 9486ebab-256f-4804-8951-c29abca195b6 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.compute.manager [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Ensure instance console log exists: /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.policy [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.compute.manager [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:57:17 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Creating image(s)
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "/opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "/opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "/opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.network.neutron [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Successfully created port: 7bd93bff-fc7a-41e9-af2b-f68d4c30b806 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk 1073741824" returned: 0 in 0.055s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG os_brick.utils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b4f274-e77a-4c83-a231-c0ddcfd7c5f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a27d14-643a-4465-bfcc-0a68f945b527]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.147s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[655929d3-ac3c-4b45-96b0-2e51bdce8ae5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe59622b-22cd-4148-8b1f-a0559494adbd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:57:17 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a968a97-3230-47d3-99a2-e4421a0a5f78]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG os_brick.utils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Updating existing volume attachment record: e0a65067-7ac1-4efc-8d78-70bb45b728b5 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Cannot resize image /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.objects.instance [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'migration_context' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Ensure instance console log exists: /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.network.neutron [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Successfully created port: 914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.network.neutron [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Successfully updated port: 7bd93bff-fc7a-41e9-af2b-f68d4c30b806 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "refresh_cache-9486ebab-256f-4804-8951-c29abca195b6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquired lock "refresh_cache-9486ebab-256f-4804-8951-c29abca195b6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.network.neutron [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-5d701df2-09f7-4bc9-af27-81796ae7d645 req-8892be94-9849-4d28-a480-1862471a8643 service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Received event network-changed-7bd93bff-fc7a-41e9-af2b-f68d4c30b806 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-5d701df2-09f7-4bc9-af27-81796ae7d645 req-8892be94-9849-4d28-a480-1862471a8643 service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Refreshing instance network info cache due to event network-changed-7bd93bff-fc7a-41e9-af2b-f68d4c30b806. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5d701df2-09f7-4bc9-af27-81796ae7d645 req-8892be94-9849-4d28-a480-1862471a8643 service nova] Acquiring lock "refresh_cache-9486ebab-256f-4804-8951-c29abca195b6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.network.neutron [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.network.neutron [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Updating instance_info_cache with network_info: [{"id": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "address": "fa:16:3e:6e:bb:a9", "network": {"id": "55e94647-7a05-4146-9aed-8da785afd9f1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2f1c68f95cc4183b127590afce31d0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd93bff-fc", "ovs_interfaceid": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Releasing lock "refresh_cache-9486ebab-256f-4804-8951-c29abca195b6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Instance network_info: |[{"id": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "address": "fa:16:3e:6e:bb:a9", "network": {"id": "55e94647-7a05-4146-9aed-8da785afd9f1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2f1c68f95cc4183b127590afce31d0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd93bff-fc", "ovs_interfaceid": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5d701df2-09f7-4bc9-af27-81796ae7d645 req-8892be94-9849-4d28-a480-1862471a8643 service nova] Acquired lock "refresh_cache-9486ebab-256f-4804-8951-c29abca195b6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.network.neutron [req-5d701df2-09f7-4bc9-af27-81796ae7d645 req-8892be94-9849-4d28-a480-1862471a8643 service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Refreshing network info cache for port 7bd93bff-fc7a-41e9-af2b-f68d4c30b806 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Start _get_guest_xml network_info=[{"id": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "address": "fa:16:3e:6e:bb:a9", "network": {"id": "55e94647-7a05-4146-9aed-8da785afd9f1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2f1c68f95cc4183b127590afce31d0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd93bff-fc", "ovs_interfaceid": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:57:18 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:57:18 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1230566984',display_name='tempest-VolumesNegativeTest-instance-1230566984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1230566984',id=22,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0294841cf2b746d3880854c2570a3657',ramdisk_id='',reservation_id='r-jbk85v04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1501095424',owner_user_name='tempest-VolumesNegativeTest-1501095424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:57:16Z,user_data=None,user_id='6b5df01d8bd0454f8ea96a5cdfe0df42',uuid=9486ebab-256f-4804-8951-c29abca195b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "address": "fa:16:3e:6e:bb:a9", "network": {"id": "55e94647-7a05-4146-9aed-8da785afd9f1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2f1c68f95cc4183b127590afce31d0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd93bff-fc", "ovs_interfaceid": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Converting VIF {"id": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "address": "fa:16:3e:6e:bb:a9", "network": {"id": "55e94647-7a05-4146-9aed-8da785afd9f1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2f1c68f95cc4183b127590afce31d0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd93bff-fc", "ovs_interfaceid": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:bb:a9,bridge_name='br-int',has_traffic_filtering=True,id=7bd93bff-fc7a-41e9-af2b-f68d4c30b806,network=Network(55e94647-7a05-4146-9aed-8da785afd9f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd93bff-fc') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.objects.instance [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lazy-loading 'pci_devices' on Instance uuid 9486ebab-256f-4804-8951-c29abca195b6 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:57:18 user nova-compute[71364]:   <uuid>9486ebab-256f-4804-8951-c29abca195b6</uuid>
Apr 11 21:57:18 user nova-compute[71364]:   <name>instance-00000016</name>
Apr 11 21:57:18 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:57:18 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:57:18 user nova-compute[71364]:   <metadata>
Apr 11 21:57:18 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:57:18 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:57:18 user nova-compute[71364]:       <nova:name>tempest-VolumesNegativeTest-instance-1230566984</nova:name>
Apr 11 21:57:18 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:57:18</nova:creationTime>
Apr 11 21:57:18 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:57:18 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:57:18 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:57:18 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:57:18 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:57:18 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:57:18 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:57:18 user nova-compute[71364]:       <nova:owner>
Apr 11 21:57:18 user nova-compute[71364]:         <nova:user uuid="6b5df01d8bd0454f8ea96a5cdfe0df42">tempest-VolumesNegativeTest-1501095424-project-member</nova:user>
Apr 11 21:57:18 user nova-compute[71364]:         <nova:project uuid="0294841cf2b746d3880854c2570a3657">tempest-VolumesNegativeTest-1501095424</nova:project>
Apr 11 21:57:18 user nova-compute[71364]:       </nova:owner>
Apr 11 21:57:18 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:57:18 user nova-compute[71364]:       <nova:ports>
Apr 11 21:57:18 user nova-compute[71364]:         <nova:port uuid="7bd93bff-fc7a-41e9-af2b-f68d4c30b806">
Apr 11 21:57:18 user nova-compute[71364]:           <nova:ip type="fixed" address="192.168.233.28" ipVersion="4"/>
Apr 11 21:57:18 user nova-compute[71364]:         </nova:port>
Apr 11 21:57:18 user nova-compute[71364]:       </nova:ports>
Apr 11 21:57:18 user nova-compute[71364]:     </nova:instance>
Apr 11 21:57:18 user nova-compute[71364]:   </metadata>
Apr 11 21:57:18 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:57:18 user nova-compute[71364]:     <system>
Apr 11 21:57:18 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:57:18 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:57:18 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:57:18 user nova-compute[71364]:       <entry name="serial">9486ebab-256f-4804-8951-c29abca195b6</entry>
Apr 11 21:57:18 user nova-compute[71364]:       <entry name="uuid">9486ebab-256f-4804-8951-c29abca195b6</entry>
Apr 11 21:57:18 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:57:18 user nova-compute[71364]:     </system>
Apr 11 21:57:18 user nova-compute[71364]:   </sysinfo>
Apr 11 21:57:18 user nova-compute[71364]:   <os>
Apr 11 21:57:18 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:57:18 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:57:18 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:57:18 user nova-compute[71364]:   </os>
Apr 11 21:57:18 user nova-compute[71364]:   <features>
Apr 11 21:57:18 user nova-compute[71364]:     <acpi/>
Apr 11 21:57:18 user nova-compute[71364]:     <apic/>
Apr 11 21:57:18 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:57:18 user nova-compute[71364]:   </features>
Apr 11 21:57:18 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:57:18 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:57:18 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:57:18 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:57:18 user nova-compute[71364]:   </clock>
Apr 11 21:57:18 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:57:18 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:57:18 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:57:18 user nova-compute[71364]:   </cpu>
Apr 11 21:57:18 user nova-compute[71364]:   <devices>
Apr 11 21:57:18 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:57:18 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:57:18 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk"/>
Apr 11 21:57:18 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:57:18 user nova-compute[71364]:     </disk>
Apr 11 21:57:18 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:57:18 user nova-compute[71364]:       <mac address="fa:16:3e:6e:bb:a9"/>
Apr 11 21:57:18 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:57:18 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:57:18 user nova-compute[71364]:       <target dev="tap7bd93bff-fc"/>
Apr 11 21:57:18 user nova-compute[71364]:     </interface>
Apr 11 21:57:18 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:57:18 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/console.log" append="off"/>
Apr 11 21:57:18 user nova-compute[71364]:     </serial>
Apr 11 21:57:18 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:57:18 user nova-compute[71364]:     <video>
Apr 11 21:57:18 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:57:18 user nova-compute[71364]:     </video>
Apr 11 21:57:18 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:57:18 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:57:18 user nova-compute[71364]:     </rng>
Apr 11 21:57:18 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:57:18 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:57:18 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:57:18 user nova-compute[71364]:     </memballoon>
Apr 11 21:57:18 user nova-compute[71364]:   </devices>
Apr 11 21:57:18 user nova-compute[71364]: </domain>
Apr 11 21:57:18 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1230566984',display_name='tempest-VolumesNegativeTest-instance-1230566984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1230566984',id=22,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0294841cf2b746d3880854c2570a3657',ramdisk_id='',reservation_id='r-jbk85v04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1501095424',owner_user_name='tempest-VolumesNegativeTest-1501095424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:57:16Z,user_data=None,user_id='6b5df01d8bd0454f8ea96a5cdfe0df42',uuid=9486ebab-256f-4804-8951-c29abca195b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "address": "fa:16:3e:6e:bb:a9", "network": {"id": "55e94647-7a05-4146-9aed-8da785afd9f1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2f1c68f95cc4183b127590afce31d0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd93bff-fc", "ovs_interfaceid": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Converting VIF {"id": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "address": "fa:16:3e:6e:bb:a9", "network": {"id": "55e94647-7a05-4146-9aed-8da785afd9f1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2f1c68f95cc4183b127590afce31d0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd93bff-fc", "ovs_interfaceid": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:bb:a9,bridge_name='br-int',has_traffic_filtering=True,id=7bd93bff-fc7a-41e9-af2b-f68d4c30b806,network=Network(55e94647-7a05-4146-9aed-8da785afd9f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd93bff-fc') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG os_vif [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:bb:a9,bridge_name='br-int',has_traffic_filtering=True,id=7bd93bff-fc7a-41e9-af2b-f68d4c30b806,network=Network(55e94647-7a05-4146-9aed-8da785afd9f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd93bff-fc') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bd93bff-fc, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7bd93bff-fc, col_values=(('external_ids', {'iface-id': '7bd93bff-fc7a-41e9-af2b-f68d4c30b806', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:bb:a9', 'vm-uuid': '9486ebab-256f-4804-8951-c29abca195b6'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:18 user nova-compute[71364]: INFO os_vif [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:bb:a9,bridge_name='br-int',has_traffic_filtering=True,id=7bd93bff-fc7a-41e9-af2b-f68d4c30b806,network=Network(55e94647-7a05-4146-9aed-8da785afd9f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd93bff-fc')
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] No VIF found with MAC fa:16:3e:6e:bb:a9, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.network.neutron [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Successfully updated port: 914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquired lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.network.neutron [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-8963076f-ad42-4811-8daf-08980c6801d4 req-364cf7d8-d68e-4a7c-8889-d9f51d68c2a4 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-changed-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-8963076f-ad42-4811-8daf-08980c6801d4 req-364cf7d8-d68e-4a7c-8889-d9f51d68c2a4 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Refreshing instance network info cache due to event network-changed-914c7aea-325c-4061-893a-353590f63b84. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8963076f-ad42-4811-8daf-08980c6801d4 req-364cf7d8-d68e-4a7c-8889-d9f51d68c2a4 service nova] Acquiring lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:18 user nova-compute[71364]: DEBUG nova.network.neutron [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.network.neutron [req-5d701df2-09f7-4bc9-af27-81796ae7d645 req-8892be94-9849-4d28-a480-1862471a8643 service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Updated VIF entry in instance network info cache for port 7bd93bff-fc7a-41e9-af2b-f68d4c30b806. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.network.neutron [req-5d701df2-09f7-4bc9-af27-81796ae7d645 req-8892be94-9849-4d28-a480-1862471a8643 service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Updating instance_info_cache with network_info: [{"id": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "address": "fa:16:3e:6e:bb:a9", "network": {"id": "55e94647-7a05-4146-9aed-8da785afd9f1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2f1c68f95cc4183b127590afce31d0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd93bff-fc", "ovs_interfaceid": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5d701df2-09f7-4bc9-af27-81796ae7d645 req-8892be94-9849-4d28-a480-1862471a8643 service nova] Releasing lock "refresh_cache-9486ebab-256f-4804-8951-c29abca195b6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Updating instance_info_cache with network_info: [{"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Releasing lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Instance network_info: |[{"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8963076f-ad42-4811-8daf-08980c6801d4 req-364cf7d8-d68e-4a7c-8889-d9f51d68c2a4 service nova] Acquired lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.network.neutron [req-8963076f-ad42-4811-8daf-08980c6801d4 req-364cf7d8-d68e-4a7c-8889-d9f51d68c2a4 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Refreshing network info cache for port 914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Start _get_guest_xml network_info=[{"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:57:19 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:57:19 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-725789604',display_name='tempest-AttachVolumeTestJSON-server-725789604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-725789604',id=23,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYwKlNnt0rCNL8sjxDa6Udl9GHywucHycueHP/WPlPumIvAabJq5jTPAthhGusMxnokX9UxhPJGgZI9+13actfeG6CHskRBehNb6fTqc1ot1bspfEW3rpY449P/8ec+gw==',key_name='tempest-keypair-654553624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5aa35cf81ae74532a074bde65f192848',ramdisk_id='',reservation_id='r-q3i4b0c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1865595781',owner_user_name='tempest-AttachVolumeTestJSON-1865595781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:57:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76211a47ed9b4a8abdeeea98c774d3d7',uuid=53530e4f-a899-496d-8b83-a3b5f7dbc7ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converting VIF {"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.objects.instance [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'pci_devices' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:57:19 user nova-compute[71364]:   <uuid>53530e4f-a899-496d-8b83-a3b5f7dbc7ea</uuid>
Apr 11 21:57:19 user nova-compute[71364]:   <name>instance-00000017</name>
Apr 11 21:57:19 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:57:19 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:57:19 user nova-compute[71364]:   <metadata>
Apr 11 21:57:19 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:57:19 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:57:19 user nova-compute[71364]:       <nova:name>tempest-AttachVolumeTestJSON-server-725789604</nova:name>
Apr 11 21:57:19 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:57:19</nova:creationTime>
Apr 11 21:57:19 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:57:19 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:57:19 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:57:19 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:57:19 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:57:19 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:57:19 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:57:19 user nova-compute[71364]:       <nova:owner>
Apr 11 21:57:19 user nova-compute[71364]:         <nova:user uuid="76211a47ed9b4a8abdeeea98c774d3d7">tempest-AttachVolumeTestJSON-1865595781-project-member</nova:user>
Apr 11 21:57:19 user nova-compute[71364]:         <nova:project uuid="5aa35cf81ae74532a074bde65f192848">tempest-AttachVolumeTestJSON-1865595781</nova:project>
Apr 11 21:57:19 user nova-compute[71364]:       </nova:owner>
Apr 11 21:57:19 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:57:19 user nova-compute[71364]:       <nova:ports>
Apr 11 21:57:19 user nova-compute[71364]:         <nova:port uuid="914c7aea-325c-4061-893a-353590f63b84">
Apr 11 21:57:19 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 21:57:19 user nova-compute[71364]:         </nova:port>
Apr 11 21:57:19 user nova-compute[71364]:       </nova:ports>
Apr 11 21:57:19 user nova-compute[71364]:     </nova:instance>
Apr 11 21:57:19 user nova-compute[71364]:   </metadata>
Apr 11 21:57:19 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:57:19 user nova-compute[71364]:     <system>
Apr 11 21:57:19 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:57:19 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:57:19 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:57:19 user nova-compute[71364]:       <entry name="serial">53530e4f-a899-496d-8b83-a3b5f7dbc7ea</entry>
Apr 11 21:57:19 user nova-compute[71364]:       <entry name="uuid">53530e4f-a899-496d-8b83-a3b5f7dbc7ea</entry>
Apr 11 21:57:19 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:57:19 user nova-compute[71364]:     </system>
Apr 11 21:57:19 user nova-compute[71364]:   </sysinfo>
Apr 11 21:57:19 user nova-compute[71364]:   <os>
Apr 11 21:57:19 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:57:19 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:57:19 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:57:19 user nova-compute[71364]:   </os>
Apr 11 21:57:19 user nova-compute[71364]:   <features>
Apr 11 21:57:19 user nova-compute[71364]:     <acpi/>
Apr 11 21:57:19 user nova-compute[71364]:     <apic/>
Apr 11 21:57:19 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:57:19 user nova-compute[71364]:   </features>
Apr 11 21:57:19 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:57:19 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:57:19 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:57:19 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:57:19 user nova-compute[71364]:   </clock>
Apr 11 21:57:19 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:57:19 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:57:19 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:57:19 user nova-compute[71364]:   </cpu>
Apr 11 21:57:19 user nova-compute[71364]:   <devices>
Apr 11 21:57:19 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:57:19 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:57:19 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk"/>
Apr 11 21:57:19 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:57:19 user nova-compute[71364]:     </disk>
Apr 11 21:57:19 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:57:19 user nova-compute[71364]:       <mac address="fa:16:3e:fb:64:5e"/>
Apr 11 21:57:19 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:57:19 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:57:19 user nova-compute[71364]:       <target dev="tap914c7aea-32"/>
Apr 11 21:57:19 user nova-compute[71364]:     </interface>
Apr 11 21:57:19 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:57:19 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/console.log" append="off"/>
Apr 11 21:57:19 user nova-compute[71364]:     </serial>
Apr 11 21:57:19 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:57:19 user nova-compute[71364]:     <video>
Apr 11 21:57:19 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:57:19 user nova-compute[71364]:     </video>
Apr 11 21:57:19 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:57:19 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:57:19 user nova-compute[71364]:     </rng>
Apr 11 21:57:19 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:57:19 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:57:19 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:57:19 user nova-compute[71364]:     </memballoon>
Apr 11 21:57:19 user nova-compute[71364]:   </devices>
Apr 11 21:57:19 user nova-compute[71364]: </domain>
Apr 11 21:57:19 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-725789604',display_name='tempest-AttachVolumeTestJSON-server-725789604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-725789604',id=23,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYwKlNnt0rCNL8sjxDa6Udl9GHywucHycueHP/WPlPumIvAabJq5jTPAthhGusMxnokX9UxhPJGgZI9+13actfeG6CHskRBehNb6fTqc1ot1bspfEW3rpY449P/8ec+gw==',key_name='tempest-keypair-654553624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5aa35cf81ae74532a074bde65f192848',ramdisk_id='',reservation_id='r-q3i4b0c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1865595781',owner_user_name='tempest-AttachVolumeTestJSON-1865595781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:57:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76211a47ed9b4a8abdeeea98c774d3d7',uuid=53530e4f-a899-496d-8b83-a3b5f7dbc7ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converting VIF {"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG os_vif [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap914c7aea-32, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap914c7aea-32, col_values=(('external_ids', {'iface-id': '914c7aea-325c-4061-893a-353590f63b84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:64:5e', 'vm-uuid': '53530e4f-a899-496d-8b83-a3b5f7dbc7ea'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:19 user nova-compute[71364]: INFO os_vif [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32')
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] No VIF found with MAC fa:16:3e:fb:64:5e, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.network.neutron [req-8963076f-ad42-4811-8daf-08980c6801d4 req-364cf7d8-d68e-4a7c-8889-d9f51d68c2a4 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Updated VIF entry in instance network info cache for port 914c7aea-325c-4061-893a-353590f63b84. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG nova.network.neutron [req-8963076f-ad42-4811-8daf-08980c6801d4 req-364cf7d8-d68e-4a7c-8889-d9f51d68c2a4 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Updating instance_info_cache with network_info: [{"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:57:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8963076f-ad42-4811-8daf-08980c6801d4 req-364cf7d8-d68e-4a7c-8889-d9f51d68c2a4 service nova] Releasing lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:57:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-154eb009-1e0a-4982-953d-436ccdc23321 req-a194df60-4be0-4d4f-a4cb-ae1a714f70fc service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Received event network-vif-plugged-7bd93bff-fc7a-41e9-af2b-f68d4c30b806 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-154eb009-1e0a-4982-953d-436ccdc23321 req-a194df60-4be0-4d4f-a4cb-ae1a714f70fc service nova] Acquiring lock "9486ebab-256f-4804-8951-c29abca195b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-154eb009-1e0a-4982-953d-436ccdc23321 req-a194df60-4be0-4d4f-a4cb-ae1a714f70fc service nova] Lock "9486ebab-256f-4804-8951-c29abca195b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-154eb009-1e0a-4982-953d-436ccdc23321 req-a194df60-4be0-4d4f-a4cb-ae1a714f70fc service nova] Lock "9486ebab-256f-4804-8951-c29abca195b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-154eb009-1e0a-4982-953d-436ccdc23321 req-a194df60-4be0-4d4f-a4cb-ae1a714f70fc service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] No waiting events found dispatching network-vif-plugged-7bd93bff-fc7a-41e9-af2b-f68d4c30b806 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:57:20 user nova-compute[71364]: WARNING nova.compute.manager [req-154eb009-1e0a-4982-953d-436ccdc23321 req-a194df60-4be0-4d4f-a4cb-ae1a714f70fc service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Received unexpected event network-vif-plugged-7bd93bff-fc7a-41e9-af2b-f68d4c30b806 for instance with vm_state building and task_state spawning.
Apr 11 21:57:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:21 user nova-compute[71364]: DEBUG nova.compute.manager [req-f0b6ef7a-aa2d-4f95-aed2-a357f40317c1 req-a45559a1-43bb-4d5d-8cb7-0343172f1d79 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f0b6ef7a-aa2d-4f95-aed2-a357f40317c1 req-a45559a1-43bb-4d5d-8cb7-0343172f1d79 service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f0b6ef7a-aa2d-4f95-aed2-a357f40317c1 req-a45559a1-43bb-4d5d-8cb7-0343172f1d79 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f0b6ef7a-aa2d-4f95-aed2-a357f40317c1 req-a45559a1-43bb-4d5d-8cb7-0343172f1d79 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:21 user nova-compute[71364]: DEBUG nova.compute.manager [req-f0b6ef7a-aa2d-4f95-aed2-a357f40317c1 req-a45559a1-43bb-4d5d-8cb7-0343172f1d79 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:57:21 user nova-compute[71364]: WARNING nova.compute.manager [req-f0b6ef7a-aa2d-4f95-aed2-a357f40317c1 req-a45559a1-43bb-4d5d-8cb7-0343172f1d79 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state building and task_state spawning.
Apr 11 21:57:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:57:22 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Creating image(s)
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Ensure instance console log exists: /opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Start _get_guest_xml network_info=[{"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RChlkXFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c48d8944-6010-4d8d-9761-6ee0d7cd005b', 'attached_at': '', 'detached_at': '', 'volume_id': '34069ab4-9b63-44e2-98f1-f518605db084', 'serial': '34069ab4-9b63-44e2-98f1-f518605db084'}, 'attachment_id': 'e0a65067-7ac1-4efc-8d78-70bb45b728b5', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:57:22 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:57:22 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RChlkXFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:57:22 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:57:22 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:57:22 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f3ec27-fee3-488b-a377-5781f6a76c02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:57:22 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f48499-7d6e-465e-a6ab-970ee80f26d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084] added
Apr 11 21:57:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1d5334-6e79-469b-883a-43c48fa2bfbc]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b5c6d2-9e88-4fff-a1e2-bf876a7425d7]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RChlkXFY {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RChlkXFY" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[72717d39-6435-43f9-9a7d-2de0dc063589]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RChlkXFY'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cfc1c3-8165-4369-8c06-c2540facee9a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef57773-c90e-4ddc-918b-e9d3a3325334]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:57:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:57:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c9c76b-2fb4-4d6c-b2f0-6ec5cc5cd8af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084, portal: 172.16.0.220,3260]
Apr 11 21:57:22 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084, portal: 172.16.0.220,3260] successful.
Apr 11 21:57:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc41dc2a-e421-495a-9e4b-128909af704f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[923aeb33-7928-4eb0-b59b-9b1cc2624fd8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:57:22 user nova-compute[71364]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:57:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:57:22 user nova-compute[71364]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:57:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e879f3-d231-4ce1-a790-7366f313df49]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RChlkXFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-0f3a4ccd-4a48-4bc6-800e-e4feb2812736 req-f4624ae5-006b-4fb5-aa26-c131991f7a65 service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Received event network-vif-plugged-7bd93bff-fc7a-41e9-af2b-f68d4c30b806 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0f3a4ccd-4a48-4bc6-800e-e4feb2812736 req-f4624ae5-006b-4fb5-aa26-c131991f7a65 service nova] Acquiring lock "9486ebab-256f-4804-8951-c29abca195b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0f3a4ccd-4a48-4bc6-800e-e4feb2812736 req-f4624ae5-006b-4fb5-aa26-c131991f7a65 service nova] Lock "9486ebab-256f-4804-8951-c29abca195b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0f3a4ccd-4a48-4bc6-800e-e4feb2812736 req-f4624ae5-006b-4fb5-aa26-c131991f7a65 service nova] Lock "9486ebab-256f-4804-8951-c29abca195b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-0f3a4ccd-4a48-4bc6-800e-e4feb2812736 req-f4624ae5-006b-4fb5-aa26-c131991f7a65 service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] No waiting events found dispatching network-vif-plugged-7bd93bff-fc7a-41e9-af2b-f68d4c30b806 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:57:22 user nova-compute[71364]: WARNING nova.compute.manager [req-0f3a4ccd-4a48-4bc6-800e-e4feb2812736 req-f4624ae5-006b-4fb5-aa26-c131991f7a65 service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Received unexpected event network-vif-plugged-7bd93bff-fc7a-41e9-af2b-f68d4c30b806 for instance with vm_state building and task_state spawning.
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250243.3557868, 9486ebab-256f-4804-8951-c29abca195b6 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:57:23 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9486ebab-256f-4804-8951-c29abca195b6] VM Resumed (Lifecycle Event)
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:57:23 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Instance spawned successfully.
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:23 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9486ebab-256f-4804-8951-c29abca195b6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250243.3605866, 9486ebab-256f-4804-8951-c29abca195b6 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:57:23 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9486ebab-256f-4804-8951-c29abca195b6] VM Started (Lifecycle Event)
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:57:23 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9486ebab-256f-4804-8951-c29abca195b6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:57:23 user nova-compute[71364]: INFO nova.compute.manager [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Took 6.96 seconds to spawn the instance on the hypervisor.
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23332613731393337', 'path': '/dev/sdc'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332613731393337', 'path': '/dev/sdc'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:57:23 user nova-compute[71364]: INFO nova.compute.manager [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Took 7.73 seconds to build instance.
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1124097939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1124097939',id=21,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53057a8fc17e400e8c26a7dec2c873f9',ramdisk_id='',reservation_id='r-vlygxs0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:57:12Z,user_data=None,user_id='10430313a8b44e6794ca88d30a83c69a',uuid=c48d8944-6010-4d8d-9761-6ee0d7cd005b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converting VIF {"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e72bd4f-57') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.objects.instance [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'pci_devices' on Instance uuid c48d8944-6010-4d8d-9761-6ee0d7cd005b {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "9486ebab-256f-4804-8951-c29abca195b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.841s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:57:23 user nova-compute[71364]:   <uuid>c48d8944-6010-4d8d-9761-6ee0d7cd005b</uuid>
Apr 11 21:57:23 user nova-compute[71364]:   <name>instance-00000015</name>
Apr 11 21:57:23 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:57:23 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:57:23 user nova-compute[71364]:   <metadata>
Apr 11 21:57:23 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:57:23 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:57:23 user nova-compute[71364]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1124097939</nova:name>
Apr 11 21:57:23 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:57:22</nova:creationTime>
Apr 11 21:57:23 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:57:23 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:57:23 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:57:23 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:57:23 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:57:23 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:57:23 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:57:23 user nova-compute[71364]:       <nova:owner>
Apr 11 21:57:23 user nova-compute[71364]:         <nova:user uuid="10430313a8b44e6794ca88d30a83c69a">tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member</nova:user>
Apr 11 21:57:23 user nova-compute[71364]:         <nova:project uuid="53057a8fc17e400e8c26a7dec2c873f9">tempest-ServerBootFromVolumeStableRescueTest-1235920472</nova:project>
Apr 11 21:57:23 user nova-compute[71364]:       </nova:owner>
Apr 11 21:57:23 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:57:23 user nova-compute[71364]:       <nova:ports>
Apr 11 21:57:23 user nova-compute[71364]:         <nova:port uuid="8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d">
Apr 11 21:57:23 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 21:57:23 user nova-compute[71364]:         </nova:port>
Apr 11 21:57:23 user nova-compute[71364]:       </nova:ports>
Apr 11 21:57:23 user nova-compute[71364]:     </nova:instance>
Apr 11 21:57:23 user nova-compute[71364]:   </metadata>
Apr 11 21:57:23 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:57:23 user nova-compute[71364]:     <system>
Apr 11 21:57:23 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:57:23 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:57:23 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:57:23 user nova-compute[71364]:       <entry name="serial">c48d8944-6010-4d8d-9761-6ee0d7cd005b</entry>
Apr 11 21:57:23 user nova-compute[71364]:       <entry name="uuid">c48d8944-6010-4d8d-9761-6ee0d7cd005b</entry>
Apr 11 21:57:23 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:57:23 user nova-compute[71364]:     </system>
Apr 11 21:57:23 user nova-compute[71364]:   </sysinfo>
Apr 11 21:57:23 user nova-compute[71364]:   <os>
Apr 11 21:57:23 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:57:23 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:57:23 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:57:23 user nova-compute[71364]:   </os>
Apr 11 21:57:23 user nova-compute[71364]:   <features>
Apr 11 21:57:23 user nova-compute[71364]:     <acpi/>
Apr 11 21:57:23 user nova-compute[71364]:     <apic/>
Apr 11 21:57:23 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:57:23 user nova-compute[71364]:   </features>
Apr 11 21:57:23 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:57:23 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:57:23 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:57:23 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:57:23 user nova-compute[71364]:   </clock>
Apr 11 21:57:23 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:57:23 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:57:23 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:57:23 user nova-compute[71364]:   </cpu>
Apr 11 21:57:23 user nova-compute[71364]:   <devices>
Apr 11 21:57:23 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 21:57:23 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:57:23 user nova-compute[71364]:       <source dev="/dev/sdc"/>
Apr 11 21:57:23 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:57:23 user nova-compute[71364]:       <serial>34069ab4-9b63-44e2-98f1-f518605db084</serial>
Apr 11 21:57:23 user nova-compute[71364]:     </disk>
Apr 11 21:57:23 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:57:23 user nova-compute[71364]:       <mac address="fa:16:3e:c4:30:2a"/>
Apr 11 21:57:23 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:57:23 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:57:23 user nova-compute[71364]:       <target dev="tap8e72bd4f-57"/>
Apr 11 21:57:23 user nova-compute[71364]:     </interface>
Apr 11 21:57:23 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:57:23 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b/console.log" append="off"/>
Apr 11 21:57:23 user nova-compute[71364]:     </serial>
Apr 11 21:57:23 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:57:23 user nova-compute[71364]:     <video>
Apr 11 21:57:23 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:57:23 user nova-compute[71364]:     </video>
Apr 11 21:57:23 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:57:23 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:57:23 user nova-compute[71364]:     </rng>
Apr 11 21:57:23 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:57:23 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:57:23 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:57:23 user nova-compute[71364]:     </memballoon>
Apr 11 21:57:23 user nova-compute[71364]:   </devices>
Apr 11 21:57:23 user nova-compute[71364]: </domain>
Apr 11 21:57:23 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1124097939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1124097939',id=21,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53057a8fc17e400e8c26a7dec2c873f9',ramdisk_id='',reservation_id='r-vlygxs0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:57:12Z,user_data=None,user_id='10430313a8b44e6794ca88d30a83c69a',uuid=c48d8944-6010-4d8d-9761-6ee0d7cd005b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converting VIF {"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e72bd4f-57') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG os_vif [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e72bd4f-57') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e72bd4f-57, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e72bd4f-57, col_values=(('external_ids', {'iface-id': '8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:30:2a', 'vm-uuid': 'c48d8944-6010-4d8d-9761-6ee0d7cd005b'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:23 user nova-compute[71364]: INFO os_vif [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e72bd4f-57')
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] No VIF found with MAC fa:16:3e:c4:30:2a, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-bfed45b9-c23b-42ee-8f95-834d2f7b910d req-4a2cdc71-155d-4a8c-ae63-7b9eda8915cb service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bfed45b9-c23b-42ee-8f95-834d2f7b910d req-4a2cdc71-155d-4a8c-ae63-7b9eda8915cb service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bfed45b9-c23b-42ee-8f95-834d2f7b910d req-4a2cdc71-155d-4a8c-ae63-7b9eda8915cb service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bfed45b9-c23b-42ee-8f95-834d2f7b910d req-4a2cdc71-155d-4a8c-ae63-7b9eda8915cb service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-bfed45b9-c23b-42ee-8f95-834d2f7b910d req-4a2cdc71-155d-4a8c-ae63-7b9eda8915cb service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:57:23 user nova-compute[71364]: WARNING nova.compute.manager [req-bfed45b9-c23b-42ee-8f95-834d2f7b910d req-4a2cdc71-155d-4a8c-ae63-7b9eda8915cb service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state building and task_state spawning.
Apr 11 21:57:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250243.9139128, 53530e4f-a899-496d-8b83-a3b5f7dbc7ea => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:57:23 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] VM Resumed (Lifecycle Event)
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:57:23 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Instance spawned successfully.
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:23 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:57:23 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250243.9166558, 53530e4f-a899-496d-8b83-a3b5f7dbc7ea => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:57:24 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] VM Started (Lifecycle Event)
Apr 11 21:57:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:57:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:57:24 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:57:24 user nova-compute[71364]: INFO nova.compute.manager [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Took 6.76 seconds to spawn the instance on the hypervisor.
Apr 11 21:57:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:57:24 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250229.1219828, 906866ce-6f86-4036-8b39-76b3e7d7c1fb => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:57:24 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] VM Stopped (Lifecycle Event)
Apr 11 21:57:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fbf30587-fdcd-44c8-941d-47c494c5a8d0 None None] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:57:24 user nova-compute[71364]: INFO nova.compute.manager [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Took 7.68 seconds to build instance.
Apr 11 21:57:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.781s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-fa8e97ac-817c-402c-b03e-7f92655626f8 req-bccf52bc-bc93-48dc-a365-4d5fb1db8e2a service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fa8e97ac-817c-402c-b03e-7f92655626f8 req-bccf52bc-bc93-48dc-a365-4d5fb1db8e2a service nova] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fa8e97ac-817c-402c-b03e-7f92655626f8 req-bccf52bc-bc93-48dc-a365-4d5fb1db8e2a service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fa8e97ac-817c-402c-b03e-7f92655626f8 req-bccf52bc-bc93-48dc-a365-4d5fb1db8e2a service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-fa8e97ac-817c-402c-b03e-7f92655626f8 req-bccf52bc-bc93-48dc-a365-4d5fb1db8e2a service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] No waiting events found dispatching network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:57:25 user nova-compute[71364]: WARNING nova.compute.manager [req-fa8e97ac-817c-402c-b03e-7f92655626f8 req-bccf52bc-bc93-48dc-a365-4d5fb1db8e2a service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received unexpected event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance with vm_state building and task_state spawning.
Apr 11 21:57:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250247.5116804, c48d8944-6010-4d8d-9761-6ee0d7cd005b => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:57:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] VM Resumed (Lifecycle Event)
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:57:27 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Instance spawned successfully.
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-0a8ad4c0-95e6-4845-bb2d-d619597f00a4 req-34d1dbde-8fdd-4ef2-8ebd-86073410b24a service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0a8ad4c0-95e6-4845-bb2d-d619597f00a4 req-34d1dbde-8fdd-4ef2-8ebd-86073410b24a service nova] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0a8ad4c0-95e6-4845-bb2d-d619597f00a4 req-34d1dbde-8fdd-4ef2-8ebd-86073410b24a service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0a8ad4c0-95e6-4845-bb2d-d619597f00a4 req-34d1dbde-8fdd-4ef2-8ebd-86073410b24a service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-0a8ad4c0-95e6-4845-bb2d-d619597f00a4 req-34d1dbde-8fdd-4ef2-8ebd-86073410b24a service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] No waiting events found dispatching network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:57:27 user nova-compute[71364]: WARNING nova.compute.manager [req-0a8ad4c0-95e6-4845-bb2d-d619597f00a4 req-34d1dbde-8fdd-4ef2-8ebd-86073410b24a service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received unexpected event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance with vm_state building and task_state spawning.
Apr 11 21:57:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250247.5164819, c48d8944-6010-4d8d-9761-6ee0d7cd005b => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:57:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] VM Started (Lifecycle Event)
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:57:27 user nova-compute[71364]: INFO nova.compute.manager [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Took 5.40 seconds to spawn the instance on the hypervisor.
Apr 11 21:57:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:57:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:57:27 user nova-compute[71364]: INFO nova.compute.manager [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Took 16.40 seconds to build instance.
Apr 11 21:57:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.506s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:29 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250234.319864, e627de16-3a8f-4510-8001-0e57a272b859 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:57:29 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: e627de16-3a8f-4510-8001-0e57a272b859] VM Stopped (Lifecycle Event)
Apr 11 21:57:29 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c44f8d3a-8216-433f-adb1-88f30c74357a None None] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:57:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-15fdeec1-5808-48c6-80ca-dd4a1c7c5e4e req-00c63249-d443-4ee4-acae-e078d324d8c4 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-changed-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-15fdeec1-5808-48c6-80ca-dd4a1c7c5e4e req-00c63249-d443-4ee4-acae-e078d324d8c4 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Refreshing instance network info cache due to event network-changed-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:57:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-15fdeec1-5808-48c6-80ca-dd4a1c7c5e4e req-00c63249-d443-4ee4-acae-e078d324d8c4 service nova] Acquiring lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:57:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-15fdeec1-5808-48c6-80ca-dd4a1c7c5e4e req-00c63249-d443-4ee4-acae-e078d324d8c4 service nova] Acquired lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:57:48 user nova-compute[71364]: DEBUG nova.network.neutron [req-15fdeec1-5808-48c6-80ca-dd4a1c7c5e4e req-00c63249-d443-4ee4-acae-e078d324d8c4 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Refreshing network info cache for port 5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "3915859d-4e2f-4568-9b02-d0733a474749" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:49 user nova-compute[71364]: INFO nova.compute.manager [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Shelve offloading
Apr 11 21:57:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG nova.network.neutron [req-15fdeec1-5808-48c6-80ca-dd4a1c7c5e4e req-00c63249-d443-4ee4-acae-e078d324d8c4 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updated VIF entry in instance network info cache for port 5ea4b5fb-b111-488e-b1e4-15e0a63b3b83. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG nova.network.neutron [req-15fdeec1-5808-48c6-80ca-dd4a1c7c5e4e req-00c63249-d443-4ee4-acae-e078d324d8c4 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updating instance_info_cache with network_info: [{"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-15fdeec1-5808-48c6-80ca-dd4a1c7c5e4e req-00c63249-d443-4ee4-acae-e078d324d8c4 service nova] Releasing lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-32a4c348-c38f-47b2-9556-9fddbc6c0be4 req-5bd24e4d-b920-44e8-b30a-13e59dec4ce2 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-unplugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-32a4c348-c38f-47b2-9556-9fddbc6c0be4 req-5bd24e4d-b920-44e8-b30a-13e59dec4ce2 service nova] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-32a4c348-c38f-47b2-9556-9fddbc6c0be4 req-5bd24e4d-b920-44e8-b30a-13e59dec4ce2 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-32a4c348-c38f-47b2-9556-9fddbc6c0be4 req-5bd24e4d-b920-44e8-b30a-13e59dec4ce2 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-32a4c348-c38f-47b2-9556-9fddbc6c0be4 req-5bd24e4d-b920-44e8-b30a-13e59dec4ce2 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] No waiting events found dispatching network-vif-unplugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:57:49 user nova-compute[71364]: WARNING nova.compute.manager [req-32a4c348-c38f-47b2-9556-9fddbc6c0be4 req-5bd24e4d-b920-44e8-b30a-13e59dec4ce2 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received unexpected event network-vif-unplugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance with vm_state active and task_state shelving.
Apr 11 21:57:49 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Instance destroyed successfully.
Apr 11 21:57:49 user nova-compute[71364]: DEBUG nova.compute.manager [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquired lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:57:49 user nova-compute[71364]: DEBUG nova.network.neutron [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:57:50 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:57:50 user nova-compute[71364]: DEBUG nova.network.neutron [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updating instance_info_cache with network_info: [{"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:57:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Releasing lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:57:50 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Instance destroyed successfully.
Apr 11 21:57:50 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lazy-loading 'resources' on Instance uuid 3915859d-4e2f-4568-9b02-d0733a474749 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-115257149',display_name='tempest-TestShelveInstance-server-115257149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-115257149',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyPTe9feerqVheMVPWgzAKCwaFOC9ArUtF6J+R4E3viM31y/cbRBAgN/fGGscghWK4rwcLJmmvX/JrdODSYEj5x0YZG9e58kVgIYJHTsbGEhKAGRr3PK3K9OZefO9EywQ==',key_name='tempest-TestShelveInstance-413583393',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:56:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6204710ef9e04099a7397acd2b027f15',ramdisk_id='',reservation_id='r-4z4pjiv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2116780630',owner_user_name='tempest-TestShelveInstance-2116780630-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:56:08Z,user_data=None,user_id='f1eb9c1fa13245dfbf9cdecd163e8e21',uuid=3915859d-4e2f-4568-9b02-d0733a474749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Converting VIF {"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83,network=Network(2fa04b01-8810-4143-8c46-44a06e013c98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea4b5fb-b1') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_vif [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83,network=Network(2fa04b01-8810-4143-8c46-44a06e013c98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea4b5fb-b1') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ea4b5fb-b1, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-239af9bf-fa02-444e-8999-f2d6aca773a5 req-f6c3ce71-a121-47f8-a350-9421ac8278eb service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-changed-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-239af9bf-fa02-444e-8999-f2d6aca773a5 req-f6c3ce71-a121-47f8-a350-9421ac8278eb service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Refreshing instance network info cache due to event network-changed-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-239af9bf-fa02-444e-8999-f2d6aca773a5 req-f6c3ce71-a121-47f8-a350-9421ac8278eb service nova] Acquiring lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-239af9bf-fa02-444e-8999-f2d6aca773a5 req-f6c3ce71-a121-47f8-a350-9421ac8278eb service nova] Acquired lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG nova.network.neutron [req-239af9bf-fa02-444e-8999-f2d6aca773a5 req-f6c3ce71-a121-47f8-a350-9421ac8278eb service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Refreshing network info cache for port 5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:51 user nova-compute[71364]: INFO os_vif [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83,network=Network(2fa04b01-8810-4143-8c46-44a06e013c98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea4b5fb-b1')
Apr 11 21:57:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQEUSMDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:57:51 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[090135e6-4667-4ecb-b14d-0cb1e041d9c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:57:51 user nova-compute[71364]: No targets found.
Apr 11 21:57:51 user nova-compute[71364]: iSNS:
Apr 11 21:57:51 user nova-compute[71364]: No targets found.
Apr 11 21:57:51 user nova-compute[71364]: STATIC:
Apr 11 21:57:51 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 21:57:51 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:57:51 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:57:51 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44
Apr 11 21:57:51 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:57:51 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:57:51 user nova-compute[71364]: FIRMWARE:
Apr 11 21:57:51 user nova-compute[71364]: No targets found.
Apr 11 21:57:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:57:51 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:57:51 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[30536557-6b91-460c-bfda-237bc3ee75cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef026c0f-eb90-4c45-a613-27f0ce7facb8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:57:51 user nova-compute[71364]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:57:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:57:51 user nova-compute[71364]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:57:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacd8bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d241ba05-7c04-4091-a5d2-3cf4a822eb63]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58918c9-df55-4d8f-bce9-3827249e9fe2]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7263e135-40e6-406e-b856-eccd568bac5b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b046e9b0-aeb3-4da9-99cb-a693f693f346]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.139s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[26010261-959a-4e5a-97f6-9da2955beeb5]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8267d84a-fe4e-41fc-b46b-6494fb146adb]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260]
Apr 11 21:57:51 user nova-compute[71364]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260] successful.
Apr 11 21:57:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d553c4b0-046b-42b5-aa22-cbef4f72165d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] <== disconnect_volume: return (406ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:57:51 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Deleting instance files /opt/stack/data/nova/instances/3915859d-4e2f-4568-9b02-d0733a474749_del
Apr 11 21:57:51 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Deletion of /opt/stack/data/nova/instances/3915859d-4e2f-4568-9b02-d0733a474749_del complete
Apr 11 21:57:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-81ef5036-2998-4ef5-9be1-7ca248f3a6eb req-e167f8a0-7797-4b7b-a5ed-46938ae32802 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-81ef5036-2998-4ef5-9be1-7ca248f3a6eb req-e167f8a0-7797-4b7b-a5ed-46938ae32802 service nova] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-81ef5036-2998-4ef5-9be1-7ca248f3a6eb req-e167f8a0-7797-4b7b-a5ed-46938ae32802 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-81ef5036-2998-4ef5-9be1-7ca248f3a6eb req-e167f8a0-7797-4b7b-a5ed-46938ae32802 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-81ef5036-2998-4ef5-9be1-7ca248f3a6eb req-e167f8a0-7797-4b7b-a5ed-46938ae32802 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] No waiting events found dispatching network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:57:51 user nova-compute[71364]: WARNING nova.compute.manager [req-81ef5036-2998-4ef5-9be1-7ca248f3a6eb req-e167f8a0-7797-4b7b-a5ed-46938ae32802 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received unexpected event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance with vm_state active and task_state shelving.
Apr 11 21:57:51 user nova-compute[71364]: DEBUG nova.network.neutron [req-239af9bf-fa02-444e-8999-f2d6aca773a5 req-f6c3ce71-a121-47f8-a350-9421ac8278eb service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updated VIF entry in instance network info cache for port 5ea4b5fb-b111-488e-b1e4-15e0a63b3b83. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG nova.network.neutron [req-239af9bf-fa02-444e-8999-f2d6aca773a5 req-f6c3ce71-a121-47f8-a350-9421ac8278eb service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updating instance_info_cache with network_info: [{"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": null, "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:57:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-239af9bf-fa02-444e-8999-f2d6aca773a5 req-f6c3ce71-a121-47f8-a350-9421ac8278eb service nova] Releasing lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:57:52 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:57:52 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Deleted allocations for instance 3915859d-4e2f-4568-9b02-d0733a474749
Apr 11 21:57:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:52 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lazy-loading 'numa_topology' on Instance uuid 3915859d-4e2f-4568-9b02-d0733a474749 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:57:52 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:57:52 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:57:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "3915859d-4e2f-4568-9b02-d0733a474749" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.638s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:57:56 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:57:56 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7585MB free_disk=26.191932678222656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76315af2-c4b9-4ad5-98ea-81826524d63e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 9486ebab-256f-4804-8951-c29abca195b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:57:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:57:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:57:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:57:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:57:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:57:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:57:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating instance_info_cache with network_info: [{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:57:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:57:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:57:58 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:57:58 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:57:58 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:57:58 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:57:58 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:57:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:57:58 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:57:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.compute.manager [req-458c90ea-b2c1-48b8-aea1-9399cf0b7e4d req-135c04b4-23f4-4ae9-a3cb-1ec201784b67 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Received event network-changed-a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.compute.manager [req-458c90ea-b2c1-48b8-aea1-9399cf0b7e4d req-135c04b4-23f4-4ae9-a3cb-1ec201784b67 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Refreshing instance network info cache due to event network-changed-a85cff03-bd83-4fef-8abc-1615e5ceebd6. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-458c90ea-b2c1-48b8-aea1-9399cf0b7e4d req-135c04b4-23f4-4ae9-a3cb-1ec201784b67 service nova] Acquiring lock "refresh_cache-76315af2-c4b9-4ad5-98ea-81826524d63e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-458c90ea-b2c1-48b8-aea1-9399cf0b7e4d req-135c04b4-23f4-4ae9-a3cb-1ec201784b67 service nova] Acquired lock "refresh_cache-76315af2-c4b9-4ad5-98ea-81826524d63e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.network.neutron [req-458c90ea-b2c1-48b8-aea1-9399cf0b7e4d req-135c04b4-23f4-4ae9-a3cb-1ec201784b67 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Refreshing network info cache for port a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "76315af2-c4b9-4ad5-98ea-81826524d63e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:02 user nova-compute[71364]: INFO nova.compute.manager [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Terminating instance
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.network.neutron [req-458c90ea-b2c1-48b8-aea1-9399cf0b7e4d req-135c04b4-23f4-4ae9-a3cb-1ec201784b67 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Updated VIF entry in instance network info cache for port a85cff03-bd83-4fef-8abc-1615e5ceebd6. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.network.neutron [req-458c90ea-b2c1-48b8-aea1-9399cf0b7e4d req-135c04b4-23f4-4ae9-a3cb-1ec201784b67 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Updating instance_info_cache with network_info: [{"id": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "address": "fa:16:3e:00:33:22", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85cff03-bd", "ovs_interfaceid": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-458c90ea-b2c1-48b8-aea1-9399cf0b7e4d req-135c04b4-23f4-4ae9-a3cb-1ec201784b67 service nova] Releasing lock "refresh_cache-76315af2-c4b9-4ad5-98ea-81826524d63e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.compute.manager [req-4c95d74e-ea16-45d3-9d04-2db42836ac2f req-7b275344-3c36-4e11-a989-ec9778a53761 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Received event network-vif-unplugged-a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4c95d74e-ea16-45d3-9d04-2db42836ac2f req-7b275344-3c36-4e11-a989-ec9778a53761 service nova] Acquiring lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4c95d74e-ea16-45d3-9d04-2db42836ac2f req-7b275344-3c36-4e11-a989-ec9778a53761 service nova] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4c95d74e-ea16-45d3-9d04-2db42836ac2f req-7b275344-3c36-4e11-a989-ec9778a53761 service nova] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.compute.manager [req-4c95d74e-ea16-45d3-9d04-2db42836ac2f req-7b275344-3c36-4e11-a989-ec9778a53761 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] No waiting events found dispatching network-vif-unplugged-a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.compute.manager [req-4c95d74e-ea16-45d3-9d04-2db42836ac2f req-7b275344-3c36-4e11-a989-ec9778a53761 service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Received event network-vif-unplugged-a85cff03-bd83-4fef-8abc-1615e5ceebd6 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:02 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Instance destroyed successfully.
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.objects.instance [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lazy-loading 'resources' on Instance uuid 76315af2-c4b9-4ad5-98ea-81826524d63e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:51:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-761882032',display_name='tempest-TestStampPattern-server-761882032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-761882032',id=10,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpCRhqzUB7FAJyPBKJlCQG79NsEN1MlKiYeS6HxcdWPP0UKr1248UxMjqeqQ05u0XR5/7y/57d+iYThyqW9HhypiFf/4Et50oE3GriCFvwstOcaJA+DGlCD4+QUkbFCBA==',key_name='tempest-TestStampPattern-1506752109',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:51:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8df5d7d74644c8bb2f768e9a871f75c',ramdisk_id='',reservation_id='r-jd0mba8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1188732380',owner_user_name='tempest-TestStampPattern-1188732380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:54:11Z,user_data=None,user_id='1aeabb5e8b4b463e8481e4ae8ecc1153',uuid=76315af2-c4b9-4ad5-98ea-81826524d63e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "address": "fa:16:3e:00:33:22", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85cff03-bd", "ovs_interfaceid": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Converting VIF {"id": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "address": "fa:16:3e:00:33:22", "network": {"id": "ba787967-1d37-4f5f-8a91-3e720641c16c", "bridge": "br-int", "label": "tempest-TestStampPattern-1449789774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8df5d7d74644c8bb2f768e9a871f75c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85cff03-bd", "ovs_interfaceid": "a85cff03-bd83-4fef-8abc-1615e5ceebd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:33:22,bridge_name='br-int',has_traffic_filtering=True,id=a85cff03-bd83-4fef-8abc-1615e5ceebd6,network=Network(ba787967-1d37-4f5f-8a91-3e720641c16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa85cff03-bd') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG os_vif [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:33:22,bridge_name='br-int',has_traffic_filtering=True,id=a85cff03-bd83-4fef-8abc-1615e5ceebd6,network=Network(ba787967-1d37-4f5f-8a91-3e720641c16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa85cff03-bd') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa85cff03-bd, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:58:02 user nova-compute[71364]: INFO os_vif [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:33:22,bridge_name='br-int',has_traffic_filtering=True,id=a85cff03-bd83-4fef-8abc-1615e5ceebd6,network=Network(ba787967-1d37-4f5f-8a91-3e720641c16c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa85cff03-bd')
Apr 11 21:58:02 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Deleting instance files /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e_del
Apr 11 21:58:02 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Deletion of /opt/stack/data/nova/instances/76315af2-c4b9-4ad5-98ea-81826524d63e_del complete
Apr 11 21:58:02 user nova-compute[71364]: INFO nova.compute.manager [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 21:58:02 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:58:02 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:58:03 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Took 0.48 seconds to deallocate network for instance.
Apr 11 21:58:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-4aafb0b2-1f4f-473d-9a4a-cb2a6309b6b0 req-7451c916-d173-43b4-952e-0cd9a7a27d8b service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Received event network-vif-deleted-a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:03 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Deleted allocations for instance 76315af2-c4b9-4ad5-98ea-81826524d63e
Apr 11 21:58:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.897s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:04 user nova-compute[71364]: DEBUG nova.compute.manager [req-fdffa8c0-bd9a-4acf-b23c-5db2be936eff req-9a2bcc2c-bee1-489b-b866-45c730c1a2de service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Received event network-vif-plugged-a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:58:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fdffa8c0-bd9a-4acf-b23c-5db2be936eff req-9a2bcc2c-bee1-489b-b866-45c730c1a2de service nova] Acquiring lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fdffa8c0-bd9a-4acf-b23c-5db2be936eff req-9a2bcc2c-bee1-489b-b866-45c730c1a2de service nova] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fdffa8c0-bd9a-4acf-b23c-5db2be936eff req-9a2bcc2c-bee1-489b-b866-45c730c1a2de service nova] Lock "76315af2-c4b9-4ad5-98ea-81826524d63e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:04 user nova-compute[71364]: DEBUG nova.compute.manager [req-fdffa8c0-bd9a-4acf-b23c-5db2be936eff req-9a2bcc2c-bee1-489b-b866-45c730c1a2de service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] No waiting events found dispatching network-vif-plugged-a85cff03-bd83-4fef-8abc-1615e5ceebd6 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:58:04 user nova-compute[71364]: WARNING nova.compute.manager [req-fdffa8c0-bd9a-4acf-b23c-5db2be936eff req-9a2bcc2c-bee1-489b-b866-45c730c1a2de service nova] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Received unexpected event network-vif-plugged-a85cff03-bd83-4fef-8abc-1615e5ceebd6 for instance with vm_state deleted and task_state None.
Apr 11 21:58:04 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250269.9714386, 3915859d-4e2f-4568-9b02-d0733a474749 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:58:04 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] VM Stopped (Lifecycle Event)
Apr 11 21:58:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0ee098cd-8108-426a-8e44-411aadba26a3 None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:58:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:17 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250282.858468, 76315af2-c4b9-4ad5-98ea-81826524d63e => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:58:17 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] VM Stopped (Lifecycle Event)
Apr 11 21:58:17 user nova-compute[71364]: DEBUG nova.compute.manager [None req-393b0c6e-9e49-453d-bef4-6e33e7523e29 None None] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:58:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:58:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-a39224c1-5560-4666-8b5f-da9324ae85d1 req-380422f4-7703-4933-b9a5-e95aea876fff service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received event network-changed-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:58:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-a39224c1-5560-4666-8b5f-da9324ae85d1 req-380422f4-7703-4933-b9a5-e95aea876fff service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Refreshing instance network info cache due to event network-changed-2d06f000-3612-4f47-8d55-fcd6a395edd4. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:58:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a39224c1-5560-4666-8b5f-da9324ae85d1 req-380422f4-7703-4933-b9a5-e95aea876fff service nova] Acquiring lock "refresh_cache-cc39cc0e-7829-408b-8477-0c57d8bfa2c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:58:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a39224c1-5560-4666-8b5f-da9324ae85d1 req-380422f4-7703-4933-b9a5-e95aea876fff service nova] Acquired lock "refresh_cache-cc39cc0e-7829-408b-8477-0c57d8bfa2c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:58:27 user nova-compute[71364]: DEBUG nova.network.neutron [req-a39224c1-5560-4666-8b5f-da9324ae85d1 req-380422f4-7703-4933-b9a5-e95aea876fff service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Refreshing network info cache for port 2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:58:27 user nova-compute[71364]: DEBUG nova.network.neutron [req-a39224c1-5560-4666-8b5f-da9324ae85d1 req-380422f4-7703-4933-b9a5-e95aea876fff service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Updated VIF entry in instance network info cache for port 2d06f000-3612-4f47-8d55-fcd6a395edd4. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:58:27 user nova-compute[71364]: DEBUG nova.network.neutron [req-a39224c1-5560-4666-8b5f-da9324ae85d1 req-380422f4-7703-4933-b9a5-e95aea876fff service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Updating instance_info_cache with network_info: [{"id": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "address": "fa:16:3e:7d:db:0d", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d06f000-36", "ovs_interfaceid": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:58:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a39224c1-5560-4666-8b5f-da9324ae85d1 req-380422f4-7703-4933-b9a5-e95aea876fff service nova] Releasing lock "refresh_cache-cc39cc0e-7829-408b-8477-0c57d8bfa2c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:58:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:28 user nova-compute[71364]: DEBUG nova.objects.instance [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'flavor' on Instance uuid cc39cc0e-7829-408b-8477-0c57d8bfa2c5 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:58:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:28 user nova-compute[71364]: INFO nova.compute.manager [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Attaching volume a1ca3af8-39b5-45e4-83f1-682191717870 to /dev/vdb
Apr 11 21:58:28 user nova-compute[71364]: DEBUG os_brick.utils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:58:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05660ed-f455-4a25-b002-299a41b43ce1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4afdb85-3ac1-4cdc-aee3-4cc828e3044f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c77578-36b1-4199-9550-abad03c13548]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d737959a-f6b9-46ae-b16a-cb8544d0f4c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:58:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:58:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:58:29 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:58:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff6eddc-51ee-4986-86d6-f97c9fb02dea]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:58:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:58:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:58:29 user nova-compute[71364]: DEBUG os_brick.utils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:58:29 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Updating existing volume attachment record: 2b17f569-70b3-436f-acf4-243d36f4f428 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:58:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLKSqIaj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:58:33 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:58:33 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:58:33 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f2eef4-1197-44e0-8ecb-159747bf1052]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:58:33 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf14da69-706d-4a73-acba-6cf63bdece9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870] added
Apr 11 21:58:33 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc0b755-43a0-4982-997e-35a6dac09897]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97dca1b-363b-42ab-8412-e9712c1891d4]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GLKSqIaj {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GLKSqIaj" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5a57f0-49cb-4e9a-895f-e6ef1aed36c8]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GLKSqIaj'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5f7ac7-e860-490c-9b97-f257adcef288]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ab0020-f322-4126-b977-37864a67e9dd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:58:33 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:58:33 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[397a45be-5c6d-4954-a961-35b770d098e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870, portal: 172.16.0.220,3260]
Apr 11 21:58:33 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870, portal: 172.16.0.220,3260] successful.
Apr 11 21:58:33 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[278f1d6b-244f-4721-94f8-3bce02939d35]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d193ef0-460d-44d0-b8cc-24f65d7acf40]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:58:33 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:58:33 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:58:33 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:58:33 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7938b68c-c8eb-4770-b7c2-cd6b098c08be]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLKSqIaj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:58:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:34 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:58:34 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23961656635626331', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:58:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961656635626331', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:58:34 user nova-compute[71364]: DEBUG nova.objects.instance [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'flavor' on Instance uuid cc39cc0e-7829-408b-8477-0c57d8bfa2c5 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:58:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:58:34 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:58:34 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 21:58:34 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:58:34 user nova-compute[71364]:   <serial>a1ca3af8-39b5-45e4-83f1-682191717870</serial>
Apr 11 21:58:34 user nova-compute[71364]: </disk>
Apr 11 21:58:34 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:58:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:58:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:58:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No VIF found with MAC fa:16:3e:7d:db:0d, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:58:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.247s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:36 user nova-compute[71364]: INFO nova.compute.manager [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Terminating instance
Apr 11 21:58:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG nova.compute.manager [req-98e3ea34-fc37-4f22-b102-c71b04a1ee49 req-28ad0851-b591-4ef8-b07c-963518a32678 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Received event network-vif-unplugged-f34feb75-3b0a-4198-bdcb-0eaf289e96fb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-98e3ea34-fc37-4f22-b102-c71b04a1ee49 req-28ad0851-b591-4ef8-b07c-963518a32678 service nova] Acquiring lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-98e3ea34-fc37-4f22-b102-c71b04a1ee49 req-28ad0851-b591-4ef8-b07c-963518a32678 service nova] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-98e3ea34-fc37-4f22-b102-c71b04a1ee49 req-28ad0851-b591-4ef8-b07c-963518a32678 service nova] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG nova.compute.manager [req-98e3ea34-fc37-4f22-b102-c71b04a1ee49 req-28ad0851-b591-4ef8-b07c-963518a32678 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] No waiting events found dispatching network-vif-unplugged-f34feb75-3b0a-4198-bdcb-0eaf289e96fb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:58:36 user nova-compute[71364]: DEBUG nova.compute.manager [req-98e3ea34-fc37-4f22-b102-c71b04a1ee49 req-28ad0851-b591-4ef8-b07c-963518a32678 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Received event network-vif-unplugged-f34feb75-3b0a-4198-bdcb-0eaf289e96fb for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:58:37 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Instance destroyed successfully.
Apr 11 21:58:37 user nova-compute[71364]: DEBUG nova.objects.instance [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lazy-loading 'resources' on Instance uuid 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:58:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:49:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1737937747',display_name='tempest-ServersNegativeTestJSON-server-1737937747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1737937747',id=1,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:50:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db880c2bdad74479a85e926c37352962',ramdisk_id='',reservation_id='r-7e0ui3hz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-46827538',owner_user_name='tempest-ServersNegativeTestJSON-46827538-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:50:11Z,user_data=None,user_id='839497b8586f4d9c8cc849e1de31c0e9',uuid=514f5cac-9b1d-42e9-9619-0a2ce6c82b14,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "address": "fa:16:3e:85:6d:26", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34feb75-3b", "ovs_interfaceid": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:58:37 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Converting VIF {"id": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "address": "fa:16:3e:85:6d:26", "network": {"id": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2018356568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db880c2bdad74479a85e926c37352962", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf34feb75-3b", "ovs_interfaceid": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:58:37 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:6d:26,bridge_name='br-int',has_traffic_filtering=True,id=f34feb75-3b0a-4198-bdcb-0eaf289e96fb,network=Network(e7c6d356-dca6-4d85-ac96-dc14b5e5993d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34feb75-3b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:58:37 user nova-compute[71364]: DEBUG os_vif [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:6d:26,bridge_name='br-int',has_traffic_filtering=True,id=f34feb75-3b0a-4198-bdcb-0eaf289e96fb,network=Network(e7c6d356-dca6-4d85-ac96-dc14b5e5993d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34feb75-3b') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:58:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf34feb75-3b, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:58:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:58:37 user nova-compute[71364]: INFO os_vif [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:6d:26,bridge_name='br-int',has_traffic_filtering=True,id=f34feb75-3b0a-4198-bdcb-0eaf289e96fb,network=Network(e7c6d356-dca6-4d85-ac96-dc14b5e5993d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf34feb75-3b')
Apr 11 21:58:37 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Deleting instance files /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14_del
Apr 11 21:58:37 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Deletion of /opt/stack/data/nova/instances/514f5cac-9b1d-42e9-9619-0a2ce6c82b14_del complete
Apr 11 21:58:37 user nova-compute[71364]: INFO nova.compute.manager [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 21:58:37 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:58:37 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:58:37 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:58:37 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:58:37 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Took 0.58 seconds to deallocate network for instance.
Apr 11 21:58:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-0d629699-67bc-4409-a805-391636fca3a8 req-239cd745-b301-40f9-8c3b-b3c0bd789680 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Received event network-vif-deleted-f34feb75-3b0a-4198-bdcb-0eaf289e96fb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:58:37 user nova-compute[71364]: INFO nova.compute.manager [req-0d629699-67bc-4409-a805-391636fca3a8 req-239cd745-b301-40f9-8c3b-b3c0bd789680 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Neutron deleted interface f34feb75-3b0a-4198-bdcb-0eaf289e96fb; detaching it from the instance and deleting it from the info cache
Apr 11 21:58:37 user nova-compute[71364]: DEBUG nova.network.neutron [req-0d629699-67bc-4409-a805-391636fca3a8 req-239cd745-b301-40f9-8c3b-b3c0bd789680 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:58:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-0d629699-67bc-4409-a805-391636fca3a8 req-239cd745-b301-40f9-8c3b-b3c0bd789680 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Detach interface failed, port_id=f34feb75-3b0a-4198-bdcb-0eaf289e96fb, reason: Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:58:38 user nova-compute[71364]: INFO nova.compute.claims [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Claim successful on node user
Apr 11 21:58:38 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Deleted allocations for instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.936s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:58:38 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.policy [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.compute.manager [req-23cfa642-4dd5-4b91-bc84-6328fc6816d0 req-89c62359-12a2-4e7c-b3b2-90f3e374ed54 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Received event network-vif-plugged-f34feb75-3b0a-4198-bdcb-0eaf289e96fb {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23cfa642-4dd5-4b91-bc84-6328fc6816d0 req-89c62359-12a2-4e7c-b3b2-90f3e374ed54 service nova] Acquiring lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23cfa642-4dd5-4b91-bc84-6328fc6816d0 req-89c62359-12a2-4e7c-b3b2-90f3e374ed54 service nova] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-23cfa642-4dd5-4b91-bc84-6328fc6816d0 req-89c62359-12a2-4e7c-b3b2-90f3e374ed54 service nova] Lock "514f5cac-9b1d-42e9-9619-0a2ce6c82b14-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.compute.manager [req-23cfa642-4dd5-4b91-bc84-6328fc6816d0 req-89c62359-12a2-4e7c-b3b2-90f3e374ed54 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] No waiting events found dispatching network-vif-plugged-f34feb75-3b0a-4198-bdcb-0eaf289e96fb {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:58:38 user nova-compute[71364]: WARNING nova.compute.manager [req-23cfa642-4dd5-4b91-bc84-6328fc6816d0 req-89c62359-12a2-4e7c-b3b2-90f3e374ed54 service nova] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Received unexpected event network-vif-plugged-f34feb75-3b0a-4198-bdcb-0eaf289e96fb for instance with vm_state deleted and task_state None.
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:58:38 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Creating image(s)
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "/opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "/opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "/opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk 1073741824" returned: 0 in 0.052s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Cannot resize image /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'migration_context' on Instance uuid 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Ensure instance console log exists: /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:39 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Successfully created port: 85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Successfully updated port: 85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "refresh_cache-56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquired lock "refresh_cache-56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.compute.manager [req-fab46773-30e9-422f-a522-8121f377bfda req-365ba118-9ae5-4f27-8a95-f313b73e0953 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Received event network-changed-85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.compute.manager [req-fab46773-30e9-422f-a522-8121f377bfda req-365ba118-9ae5-4f27-8a95-f313b73e0953 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Refreshing instance network info cache due to event network-changed-85f4272f-45d2-4396-aba0-66a632eb9a74. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fab46773-30e9-422f-a522-8121f377bfda req-365ba118-9ae5-4f27-8a95-f313b73e0953 service nova] Acquiring lock "refresh_cache-56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Updating instance_info_cache with network_info: [{"id": "85f4272f-45d2-4396-aba0-66a632eb9a74", "address": "fa:16:3e:38:fa:99", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f4272f-45", "ovs_interfaceid": "85f4272f-45d2-4396-aba0-66a632eb9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Releasing lock "refresh_cache-56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Instance network_info: |[{"id": "85f4272f-45d2-4396-aba0-66a632eb9a74", "address": "fa:16:3e:38:fa:99", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f4272f-45", "ovs_interfaceid": "85f4272f-45d2-4396-aba0-66a632eb9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fab46773-30e9-422f-a522-8121f377bfda req-365ba118-9ae5-4f27-8a95-f313b73e0953 service nova] Acquired lock "refresh_cache-56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.network.neutron [req-fab46773-30e9-422f-a522-8121f377bfda req-365ba118-9ae5-4f27-8a95-f313b73e0953 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Refreshing network info cache for port 85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Start _get_guest_xml network_info=[{"id": "85f4272f-45d2-4396-aba0-66a632eb9a74", "address": "fa:16:3e:38:fa:99", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f4272f-45", "ovs_interfaceid": "85f4272f-45d2-4396-aba0-66a632eb9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:58:40 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:58:40 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2021918265',display_name='tempest-AttachVolumeNegativeTest-server-2021918265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2021918265',id=24,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5HXG4uNR4Lx0Ce/mlySrXNCX9hSl8GiFiHSNVDVef2acfJ/hC+pL91fSMxh4hMX/W1wSrf0WbvHk2Mk/eCWX6XJDnNd3lt6v/7+U4PJZ+5Q3lWD02xoO6oZPKC9tDGBg==',key_name='tempest-keypair-1376241253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='722a2704f607415ebe42af5ad98bf419',ramdisk_id='',reservation_id='r-ranp7lte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2131251711',owner_user_name='tempest-AttachVolumeNegativeTest-2131251711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:58:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d615e85afb4354b37e88b5a24429d8',uuid=56a64679-9fe1-4b14-9b71-c3a9a7ab0e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85f4272f-45d2-4396-aba0-66a632eb9a74", "address": "fa:16:3e:38:fa:99", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f4272f-45", "ovs_interfaceid": "85f4272f-45d2-4396-aba0-66a632eb9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converting VIF {"id": "85f4272f-45d2-4396-aba0-66a632eb9a74", "address": "fa:16:3e:38:fa:99", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f4272f-45", "ovs_interfaceid": "85f4272f-45d2-4396-aba0-66a632eb9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:fa:99,bridge_name='br-int',has_traffic_filtering=True,id=85f4272f-45d2-4396-aba0-66a632eb9a74,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f4272f-45') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'pci_devices' on Instance uuid 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:58:40 user nova-compute[71364]:   <uuid>56a64679-9fe1-4b14-9b71-c3a9a7ab0e91</uuid>
Apr 11 21:58:40 user nova-compute[71364]:   <name>instance-00000018</name>
Apr 11 21:58:40 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:58:40 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:58:40 user nova-compute[71364]:   <metadata>
Apr 11 21:58:40 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:58:40 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:58:40 user nova-compute[71364]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2021918265</nova:name>
Apr 11 21:58:40 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:58:40</nova:creationTime>
Apr 11 21:58:40 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:58:40 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:58:40 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:58:40 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:58:40 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:58:40 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:58:40 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:58:40 user nova-compute[71364]:       <nova:owner>
Apr 11 21:58:40 user nova-compute[71364]:         <nova:user uuid="b6d615e85afb4354b37e88b5a24429d8">tempest-AttachVolumeNegativeTest-2131251711-project-member</nova:user>
Apr 11 21:58:40 user nova-compute[71364]:         <nova:project uuid="722a2704f607415ebe42af5ad98bf419">tempest-AttachVolumeNegativeTest-2131251711</nova:project>
Apr 11 21:58:40 user nova-compute[71364]:       </nova:owner>
Apr 11 21:58:40 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:58:40 user nova-compute[71364]:       <nova:ports>
Apr 11 21:58:40 user nova-compute[71364]:         <nova:port uuid="85f4272f-45d2-4396-aba0-66a632eb9a74">
Apr 11 21:58:40 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 11 21:58:40 user nova-compute[71364]:         </nova:port>
Apr 11 21:58:40 user nova-compute[71364]:       </nova:ports>
Apr 11 21:58:40 user nova-compute[71364]:     </nova:instance>
Apr 11 21:58:40 user nova-compute[71364]:   </metadata>
Apr 11 21:58:40 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:58:40 user nova-compute[71364]:     <system>
Apr 11 21:58:40 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:58:40 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:58:40 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:58:40 user nova-compute[71364]:       <entry name="serial">56a64679-9fe1-4b14-9b71-c3a9a7ab0e91</entry>
Apr 11 21:58:40 user nova-compute[71364]:       <entry name="uuid">56a64679-9fe1-4b14-9b71-c3a9a7ab0e91</entry>
Apr 11 21:58:40 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:58:40 user nova-compute[71364]:     </system>
Apr 11 21:58:40 user nova-compute[71364]:   </sysinfo>
Apr 11 21:58:40 user nova-compute[71364]:   <os>
Apr 11 21:58:40 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:58:40 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:58:40 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:58:40 user nova-compute[71364]:   </os>
Apr 11 21:58:40 user nova-compute[71364]:   <features>
Apr 11 21:58:40 user nova-compute[71364]:     <acpi/>
Apr 11 21:58:40 user nova-compute[71364]:     <apic/>
Apr 11 21:58:40 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:58:40 user nova-compute[71364]:   </features>
Apr 11 21:58:40 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:58:40 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:58:40 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:58:40 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:58:40 user nova-compute[71364]:   </clock>
Apr 11 21:58:40 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:58:40 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:58:40 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:58:40 user nova-compute[71364]:   </cpu>
Apr 11 21:58:40 user nova-compute[71364]:   <devices>
Apr 11 21:58:40 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:58:40 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:58:40 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk"/>
Apr 11 21:58:40 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:58:40 user nova-compute[71364]:     </disk>
Apr 11 21:58:40 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:58:40 user nova-compute[71364]:       <mac address="fa:16:3e:38:fa:99"/>
Apr 11 21:58:40 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:58:40 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:58:40 user nova-compute[71364]:       <target dev="tap85f4272f-45"/>
Apr 11 21:58:40 user nova-compute[71364]:     </interface>
Apr 11 21:58:40 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:58:40 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/console.log" append="off"/>
Apr 11 21:58:40 user nova-compute[71364]:     </serial>
Apr 11 21:58:40 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:58:40 user nova-compute[71364]:     <video>
Apr 11 21:58:40 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:58:40 user nova-compute[71364]:     </video>
Apr 11 21:58:40 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:58:40 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:58:40 user nova-compute[71364]:     </rng>
Apr 11 21:58:40 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:58:40 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:58:40 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:58:40 user nova-compute[71364]:     </memballoon>
Apr 11 21:58:40 user nova-compute[71364]:   </devices>
Apr 11 21:58:40 user nova-compute[71364]: </domain>
Apr 11 21:58:40 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2021918265',display_name='tempest-AttachVolumeNegativeTest-server-2021918265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2021918265',id=24,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5HXG4uNR4Lx0Ce/mlySrXNCX9hSl8GiFiHSNVDVef2acfJ/hC+pL91fSMxh4hMX/W1wSrf0WbvHk2Mk/eCWX6XJDnNd3lt6v/7+U4PJZ+5Q3lWD02xoO6oZPKC9tDGBg==',key_name='tempest-keypair-1376241253',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='722a2704f607415ebe42af5ad98bf419',ramdisk_id='',reservation_id='r-ranp7lte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2131251711',owner_user_name='tempest-AttachVolumeNegativeTest-2131251711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:58:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d615e85afb4354b37e88b5a24429d8',uuid=56a64679-9fe1-4b14-9b71-c3a9a7ab0e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85f4272f-45d2-4396-aba0-66a632eb9a74", "address": "fa:16:3e:38:fa:99", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f4272f-45", "ovs_interfaceid": "85f4272f-45d2-4396-aba0-66a632eb9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converting VIF {"id": "85f4272f-45d2-4396-aba0-66a632eb9a74", "address": "fa:16:3e:38:fa:99", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f4272f-45", "ovs_interfaceid": "85f4272f-45d2-4396-aba0-66a632eb9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:fa:99,bridge_name='br-int',has_traffic_filtering=True,id=85f4272f-45d2-4396-aba0-66a632eb9a74,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f4272f-45') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG os_vif [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:fa:99,bridge_name='br-int',has_traffic_filtering=True,id=85f4272f-45d2-4396-aba0-66a632eb9a74,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f4272f-45') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85f4272f-45, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap85f4272f-45, col_values=(('external_ids', {'iface-id': '85f4272f-45d2-4396-aba0-66a632eb9a74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:fa:99', 'vm-uuid': '56a64679-9fe1-4b14-9b71-c3a9a7ab0e91'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:40 user nova-compute[71364]: INFO os_vif [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:fa:99,bridge_name='br-int',has_traffic_filtering=True,id=85f4272f-45d2-4396-aba0-66a632eb9a74,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f4272f-45')
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:58:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No VIF found with MAC fa:16:3e:38:fa:99, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:58:41 user nova-compute[71364]: DEBUG nova.network.neutron [req-fab46773-30e9-422f-a522-8121f377bfda req-365ba118-9ae5-4f27-8a95-f313b73e0953 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Updated VIF entry in instance network info cache for port 85f4272f-45d2-4396-aba0-66a632eb9a74. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:58:41 user nova-compute[71364]: DEBUG nova.network.neutron [req-fab46773-30e9-422f-a522-8121f377bfda req-365ba118-9ae5-4f27-8a95-f313b73e0953 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Updating instance_info_cache with network_info: [{"id": "85f4272f-45d2-4396-aba0-66a632eb9a74", "address": "fa:16:3e:38:fa:99", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f4272f-45", "ovs_interfaceid": "85f4272f-45d2-4396-aba0-66a632eb9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:58:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fab46773-30e9-422f-a522-8121f377bfda req-365ba118-9ae5-4f27-8a95-f313b73e0953 service nova] Releasing lock "refresh_cache-56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-e6d4b181-0555-46b9-b7d8-dc2d83d86427 req-f48e35d0-caff-4e98-a3b0-60c2341c4f2d service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Received event network-vif-plugged-85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e6d4b181-0555-46b9-b7d8-dc2d83d86427 req-f48e35d0-caff-4e98-a3b0-60c2341c4f2d service nova] Acquiring lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e6d4b181-0555-46b9-b7d8-dc2d83d86427 req-f48e35d0-caff-4e98-a3b0-60c2341c4f2d service nova] Lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e6d4b181-0555-46b9-b7d8-dc2d83d86427 req-f48e35d0-caff-4e98-a3b0-60c2341c4f2d service nova] Lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-e6d4b181-0555-46b9-b7d8-dc2d83d86427 req-f48e35d0-caff-4e98-a3b0-60c2341c4f2d service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] No waiting events found dispatching network-vif-plugged-85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:58:42 user nova-compute[71364]: WARNING nova.compute.manager [req-e6d4b181-0555-46b9-b7d8-dc2d83d86427 req-f48e35d0-caff-4e98-a3b0-60c2341c4f2d service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Received unexpected event network-vif-plugged-85f4272f-45d2-4396-aba0-66a632eb9a74 for instance with vm_state building and task_state spawning.
Apr 11 21:58:42 user nova-compute[71364]: DEBUG nova.objects.instance [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'flavor' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:42 user nova-compute[71364]: INFO nova.compute.manager [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Attaching volume 5b60671b-b0ac-47d4-8d1a-8001771bd0ab to /dev/vdb
Apr 11 21:58:42 user nova-compute[71364]: DEBUG os_brick.utils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9140f170-9126-4543-88aa-ceeaaee4023c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b077d63f-9138-4dbd-bcee-28ddf6ee0349]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c858b07-e2d6-4a44-96ce-0f5382f1484d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[67838a08-10fb-4704-9a9b-a554b0217d5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:58:42 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:58:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06b4337-daed-44ee-9cdb-b4006ee07985]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG os_brick.utils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:58:42 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating existing volume attachment record: 93edd5ca-f46e-415e-af93-62355532b832 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:58:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250324.2297034, 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:58:44 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] VM Resumed (Lifecycle Event)
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:58:44 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Instance spawned successfully.
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 21:58:44 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250324.2302854, 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:58:44 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] VM Started (Lifecycle Event)
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:58:44 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:58:44 user nova-compute[71364]: INFO nova.compute.manager [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Took 5.48 seconds to spawn the instance on the hypervisor.
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-164bc176-ad4a-4676-b29e-da95b726184e req-52442e27-558f-4621-b07c-c76745c675bd service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Received event network-vif-plugged-85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-164bc176-ad4a-4676-b29e-da95b726184e req-52442e27-558f-4621-b07c-c76745c675bd service nova] Acquiring lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-164bc176-ad4a-4676-b29e-da95b726184e req-52442e27-558f-4621-b07c-c76745c675bd service nova] Lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-164bc176-ad4a-4676-b29e-da95b726184e req-52442e27-558f-4621-b07c-c76745c675bd service nova] Lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-164bc176-ad4a-4676-b29e-da95b726184e req-52442e27-558f-4621-b07c-c76745c675bd service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] No waiting events found dispatching network-vif-plugged-85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:58:44 user nova-compute[71364]: WARNING nova.compute.manager [req-164bc176-ad4a-4676-b29e-da95b726184e req-52442e27-558f-4621-b07c-c76745c675bd service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Received unexpected event network-vif-plugged-85f4272f-45d2-4396-aba0-66a632eb9a74 for instance with vm_state building and task_state spawning.
Apr 11 21:58:44 user nova-compute[71364]: INFO nova.compute.manager [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Took 6.13 seconds to build instance.
Apr 11 21:58:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.229s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dImUioOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:58:46 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:58:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:58:46 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:58:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:58:46 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d319841-6f1e-4471-9b4a-713d9d996151]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:58:46 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d0a328-00e3-436a-a94b-fa08f9c69b79]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab] added
Apr 11 21:58:46 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77fa381-afd5-43ff-9ffa-ca491be38757]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[629d8e60-32b9-42e1-90a1-a0477706e850]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dImUioOB {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dImUioOB" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea746c34-e157-41aa-9132-ae6abacf4341]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dImUioOB'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cdf573-42fb-43d8-b8b1-dc6e8c671b19]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d5132a-7be1-406c-bef1-75a0b9ad6674]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:58:46 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:58:46 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:58:46 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:58:46 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:58:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41131ed-2d74-489f-8de4-affdc7c1b730]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260]
Apr 11 21:58:47 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260] successful.
Apr 11 21:58:47 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4733cda1-e61e-4cac-afd3-b244cf7b9714]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fbaaf2-4629-4df8-8264-e4fae460ae18]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:58:47 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:58:47 user nova-compute[71364]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:58:47 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:58:47 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:58:47 user nova-compute[71364]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:58:47 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8197e1f0-0858-4360-8ee7-122d30bb2b16]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:58:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dImUioOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:58:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:58:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23334386665363065', 'path': '/dev/sdd'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:58:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334386665363065', 'path': '/dev/sdd'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:58:48 user nova-compute[71364]: DEBUG nova.objects.instance [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'flavor' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:58:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:58:48 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:58:48 user nova-compute[71364]:   <source dev="/dev/sdd"/>
Apr 11 21:58:48 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:58:48 user nova-compute[71364]:   <serial>5b60671b-b0ac-47d4-8d1a-8001771bd0ab</serial>
Apr 11 21:58:48 user nova-compute[71364]: </disk>
Apr 11 21:58:48 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:58:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:58:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:58:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No VIF found with MAC fa:16:3e:44:2c:d8, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:58:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.168s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:50 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Stashing vm_state: active {{(pid=71364) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 11 21:58:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:50 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'pci_requests' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:58:50 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:58:50 user nova-compute[71364]: INFO nova.compute.claims [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Claim successful on node user
Apr 11 21:58:50 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'resources' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:58:50 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:58:50 user nova-compute[71364]: INFO nova.compute.resource_tracker [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating resource usage from migration 01a865c7-bab2-4298-9a39-2b17a34890c5
Apr 11 21:58:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:50 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:58:50 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:58:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.400s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:50 user nova-compute[71364]: INFO nova.compute.manager [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Migrating
Apr 11 21:58:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:58:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:58:50 user nova-compute[71364]: INFO nova.compute.rpcapi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 11 21:58:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:58:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:58:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquired lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:58:50 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:58:51 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating instance_info_cache with network_info: [{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:58:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Releasing lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:58:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Starting migrate_disk_and_power_off {{(pid=71364) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 11 21:58:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-95fda084-5bc8-4b0d-a091-3ae367c30d78 req-27e0d770-4949-49cc-9cd9-35c201e649aa service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-unplugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:58:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-95fda084-5bc8-4b0d-a091-3ae367c30d78 req-27e0d770-4949-49cc-9cd9-35c201e649aa service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-95fda084-5bc8-4b0d-a091-3ae367c30d78 req-27e0d770-4949-49cc-9cd9-35c201e649aa service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-95fda084-5bc8-4b0d-a091-3ae367c30d78 req-27e0d770-4949-49cc-9cd9-35c201e649aa service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-95fda084-5bc8-4b0d-a091-3ae367c30d78 req-27e0d770-4949-49cc-9cd9-35c201e649aa service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-unplugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:58:51 user nova-compute[71364]: WARNING nova.compute.manager [req-95fda084-5bc8-4b0d-a091-3ae367c30d78 req-27e0d770-4949-49cc-9cd9-35c201e649aa service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-unplugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state active and task_state resize_migrating.
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250317.2596126, 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:58:52 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] VM Stopped (Lifecycle Event)
Apr 11 21:58:52 user nova-compute[71364]: DEBUG nova.compute.manager [None req-413c26e5-4727-4a68-9d0a-d1725d04e5ca None None] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:58:52 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance destroyed successfully.
Apr 11 21:58:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842337295',display_name='tempest-ServerActionsTestJSON-server-349398715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842337295',id=4,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-c34k408a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=5ff9bbaf-1a5e-4acd-aca3-d956728312cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1222517197-network", "vif_mac": "fa:16:3e:44:2c:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1222517197-network", "vif_mac": "fa:16:3e:44:2c:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_vif [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6144f13d-b4, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:58:52 user nova-compute[71364]: INFO os_vif [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4')
Apr 11 21:58:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dImUioOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:58:52 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b742591-a850-4f87-bca3-06d515d67b53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 21:58:52 user nova-compute[71364]: No targets found.
Apr 11 21:58:52 user nova-compute[71364]: iSNS:
Apr 11 21:58:52 user nova-compute[71364]: No targets found.
Apr 11 21:58:52 user nova-compute[71364]: STATIC:
Apr 11 21:58:52 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 21:58:52 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:58:52 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:58:52 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab
Apr 11 21:58:52 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:58:52 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:58:52 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870
Apr 11 21:58:52 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 21:58:52 user nova-compute[71364]:                 Iface Name: default
Apr 11 21:58:52 user nova-compute[71364]: FIRMWARE:
Apr 11 21:58:52 user nova-compute[71364]: No targets found.
Apr 11 21:58:52 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 21:58:52 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 21:58:52 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d5d53c-c9f7-4d2b-a3ff-0a1785d8e303]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07de513-96dc-4c1b-9fca-ba409aecd21e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:58:52 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:58:52 user nova-compute[71364]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:58:52 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:58:52 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:58:52 user nova-compute[71364]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:58:52 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff6ce5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab'): ({'sdd'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Removing single pathed devices sdd {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[272240ed-e00d-4878-a7be-9774871db53d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4cc149-8063-4a82-8414-d14d7e6e46ea]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flushing IO for device /dev/sdd {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8817b971-caec-412d-8dbd-809a640d1648]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c06fa46-8322-4d8f-86f7-2d59cbf0cff0]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb09e79-5e9f-4d13-8939-d0afd0ff5b60]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff88c49-dc5b-433d-b830-4e2d9562924f]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260]
Apr 11 21:58:52 user nova-compute[71364]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260] successful.
Apr 11 21:58:52 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[accd2e5e-4ff5-4fb1-94ab-a627e206a92b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== disconnect_volume: return (335ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:58:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb_resize/disk /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "cp -r /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb_resize/disk /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk" returned: 0 in 0.219s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb_resize/disk.info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk.info {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "cp -r /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb_resize/disk.info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk.info" returned: 0 in 0.053s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-f9f149d5-1357-4fbf-ab03-52b4cfc683cc req-f6818268-3a38-400f-94f6-e171e2e9e4a1 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f9f149d5-1357-4fbf-ab03-52b4cfc683cc req-f6818268-3a38-400f-94f6-e171e2e9e4a1 service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f9f149d5-1357-4fbf-ab03-52b4cfc683cc req-f6818268-3a38-400f-94f6-e171e2e9e4a1 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f9f149d5-1357-4fbf-ab03-52b4cfc683cc req-f6818268-3a38-400f-94f6-e171e2e9e4a1 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-f9f149d5-1357-4fbf-ab03-52b4cfc683cc req-f6818268-3a38-400f-94f6-e171e2e9e4a1 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:58:53 user nova-compute[71364]: WARNING nova.compute.manager [req-f9f149d5-1357-4fbf-ab03-52b4cfc683cc req-f6818268-3a38-400f-94f6-e171e2e9e4a1 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state active and task_state resize_migrating.
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Port 6144f13d-b463-46ef-b75b-d2d982198b72 binding to destination host user is already ACTIVE {{(pid=71364) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquired lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating instance_info_cache with network_info: [{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Releasing lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG os_brick.utils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd7f642-4f5b-4ec6-b91a-c122e701ca3f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f7c371-2629-4e28-9c64-5112f23d6738]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c487f8a-8a2c-4931-9e39-5ee24704d018]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd4488d-a9e4-4684-9160-5c35ccf26c00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:58:55 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cb3ca4-7202-4b48-a44f-fba51a44005e]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG os_brick.utils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:58:56 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:58:56 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:58:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7916MB free_disk=26.288227081298828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Applying migration context for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb as it has an incoming, in-progress migration 01a865c7-bab2-4298-9a39-2b17a34890c5. Migration status is post-migrating {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 21:58:56 user nova-compute[71364]: INFO nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating resource usage from migration 01a865c7-bab2-4298-9a39-2b17a34890c5
Apr 11 21:58:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 9486ebab-256f-4804-8951-c29abca195b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Migration 01a865c7-bab2-4298-9a39-2b17a34890c5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:58:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:58:57 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:58:57 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:58:57 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:58:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:58:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:58:59 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:58:59 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:58:59 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:58:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:58:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:58:59 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Starting finish_migration {{(pid=71364) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance directory exists: not creating {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 21:59:00 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Creating image(s)
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Updating instance_info_cache with network_info: [{"id": "2e074aaa-933c-4085-ad92-4699f1ac3975", "address": "fa:16:3e:8f:33:19", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e074aaa-93", "ovs_interfaceid": "2e074aaa-933c-4085-ad92-4699f1ac3975", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Cannot resize image /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Ensure instance console log exists: /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Start _get_guest_xml network_info=[{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1222517197-network", "vif_mac": "fa:16:3e:44:2c:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dImUioOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5ff9bbaf-1a5e-4acd-aca3-d956728312cb', 'attached_at': '2023-04-11T21:59:00.000000', 'detached_at': '', 'volume_id': '5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 'serial': '5b60671b-b0ac-47d4-8d1a-8001771bd0ab'}, 'attachment_id': '8e500458-3951-41cc-9b37-f81c1ab4ca9b', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:59:00 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:59:00 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dImUioOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:59:00 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:59:00 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:59:00 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[133676c2-b651-4bb5-a4ae-4d50fb3ebf9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:59:00 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7285195-e4c2-4bdb-8a8a-3525223495dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab] added
Apr 11 21:59:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c504a716-1559-4517-b8fd-01f404b2bc2a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a083f2-2f65-45fc-b2c9-07c20d2f078f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dImUioOB {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dImUioOB" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[306fc05b-7a17-4bfd-be19-ad9b5c4abe6b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dImUioOB'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb77fb5-836e-4989-9c85-5fd232944c15]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f890ce2-e448-4252-b151-621f522081e9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:59:00 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:59:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:59:00 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:59:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3332b767-8e29-4c77-8c0e-cbe727615d1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260]
Apr 11 21:59:00 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260] successful.
Apr 11 21:59:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b534361-253d-4133-811c-9767357123e4]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be57f83-fd8e-407c-a576-391b4ad21cc4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:59:00 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:59:00 user nova-compute[71364]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:59:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:59:00 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:59:00 user nova-compute[71364]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:59:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f176085-c51f-4e0b-9aa1-6d86a1f0b028]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:59:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dImUioOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23334386665363065', 'path': '/dev/sdd'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334386665363065', 'path': '/dev/sdd'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842337295',display_name='tempest-ServerActionsTestJSON-server-349398715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842337295',id=4,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-c34k408a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:58:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=5ff9bbaf-1a5e-4acd-aca3-d956728312cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1222517197-network", "vif_mac": "fa:16:3e:44:2c:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1222517197-network", "vif_mac": "fa:16:3e:44:2c:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:59:01 user nova-compute[71364]:   <uuid>5ff9bbaf-1a5e-4acd-aca3-d956728312cb</uuid>
Apr 11 21:59:01 user nova-compute[71364]:   <name>instance-00000004</name>
Apr 11 21:59:01 user nova-compute[71364]:   <memory>196608</memory>
Apr 11 21:59:01 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:59:01 user nova-compute[71364]:   <metadata>
Apr 11 21:59:01 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:59:01 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:59:01 user nova-compute[71364]:       <nova:name>tempest-ServerActionsTestJSON-server-349398715</nova:name>
Apr 11 21:59:01 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:59:00</nova:creationTime>
Apr 11 21:59:01 user nova-compute[71364]:       <nova:flavor name="m1.micro">
Apr 11 21:59:01 user nova-compute[71364]:         <nova:memory>192</nova:memory>
Apr 11 21:59:01 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:59:01 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:59:01 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:59:01 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:59:01 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:59:01 user nova-compute[71364]:       <nova:owner>
Apr 11 21:59:01 user nova-compute[71364]:         <nova:user uuid="939785ef89cb491aae3df4f411b2543d">tempest-ServerActionsTestJSON-434853204-project-member</nova:user>
Apr 11 21:59:01 user nova-compute[71364]:         <nova:project uuid="c9fff7d112a94e7da6bf166a6f628fed">tempest-ServerActionsTestJSON-434853204</nova:project>
Apr 11 21:59:01 user nova-compute[71364]:       </nova:owner>
Apr 11 21:59:01 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:59:01 user nova-compute[71364]:       <nova:ports>
Apr 11 21:59:01 user nova-compute[71364]:         <nova:port uuid="6144f13d-b463-46ef-b75b-d2d982198b72">
Apr 11 21:59:01 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 21:59:01 user nova-compute[71364]:         </nova:port>
Apr 11 21:59:01 user nova-compute[71364]:       </nova:ports>
Apr 11 21:59:01 user nova-compute[71364]:     </nova:instance>
Apr 11 21:59:01 user nova-compute[71364]:   </metadata>
Apr 11 21:59:01 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:59:01 user nova-compute[71364]:     <system>
Apr 11 21:59:01 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:59:01 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:59:01 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:59:01 user nova-compute[71364]:       <entry name="serial">5ff9bbaf-1a5e-4acd-aca3-d956728312cb</entry>
Apr 11 21:59:01 user nova-compute[71364]:       <entry name="uuid">5ff9bbaf-1a5e-4acd-aca3-d956728312cb</entry>
Apr 11 21:59:01 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:59:01 user nova-compute[71364]:     </system>
Apr 11 21:59:01 user nova-compute[71364]:   </sysinfo>
Apr 11 21:59:01 user nova-compute[71364]:   <os>
Apr 11 21:59:01 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:59:01 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:59:01 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:59:01 user nova-compute[71364]:   </os>
Apr 11 21:59:01 user nova-compute[71364]:   <features>
Apr 11 21:59:01 user nova-compute[71364]:     <acpi/>
Apr 11 21:59:01 user nova-compute[71364]:     <apic/>
Apr 11 21:59:01 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:59:01 user nova-compute[71364]:   </features>
Apr 11 21:59:01 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:59:01 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:59:01 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:59:01 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:59:01 user nova-compute[71364]:   </clock>
Apr 11 21:59:01 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:59:01 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:59:01 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:59:01 user nova-compute[71364]:   </cpu>
Apr 11 21:59:01 user nova-compute[71364]:   <devices>
Apr 11 21:59:01 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:59:01 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:59:01 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk"/>
Apr 11 21:59:01 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:59:01 user nova-compute[71364]:     </disk>
Apr 11 21:59:01 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 21:59:01 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:59:01 user nova-compute[71364]:       <source dev="/dev/sdd"/>
Apr 11 21:59:01 user nova-compute[71364]:       <target dev="vdb" bus="virtio"/>
Apr 11 21:59:01 user nova-compute[71364]:       <serial>5b60671b-b0ac-47d4-8d1a-8001771bd0ab</serial>
Apr 11 21:59:01 user nova-compute[71364]:     </disk>
Apr 11 21:59:01 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:59:01 user nova-compute[71364]:       <mac address="fa:16:3e:44:2c:d8"/>
Apr 11 21:59:01 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:59:01 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:59:01 user nova-compute[71364]:       <target dev="tap6144f13d-b4"/>
Apr 11 21:59:01 user nova-compute[71364]:     </interface>
Apr 11 21:59:01 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:59:01 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/console.log" append="off"/>
Apr 11 21:59:01 user nova-compute[71364]:     </serial>
Apr 11 21:59:01 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:59:01 user nova-compute[71364]:     <video>
Apr 11 21:59:01 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:59:01 user nova-compute[71364]:     </video>
Apr 11 21:59:01 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:59:01 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:59:01 user nova-compute[71364]:     </rng>
Apr 11 21:59:01 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:59:01 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:59:01 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:59:01 user nova-compute[71364]:     </memballoon>
Apr 11 21:59:01 user nova-compute[71364]:   </devices>
Apr 11 21:59:01 user nova-compute[71364]: </domain>
Apr 11 21:59:01 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842337295',display_name='tempest-ServerActionsTestJSON-server-349398715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842337295',id=4,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:54:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-c34k408a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:58:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=5ff9bbaf-1a5e-4acd-aca3-d956728312cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1222517197-network", "vif_mac": "fa:16:3e:44:2c:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1222517197-network", "vif_mac": "fa:16:3e:44:2c:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG os_vif [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6144f13d-b4, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6144f13d-b4, col_values=(('external_ids', {'iface-id': '6144f13d-b463-46ef-b75b-d2d982198b72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:2c:d8', 'vm-uuid': '5ff9bbaf-1a5e-4acd-aca3-d956728312cb'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:01 user nova-compute[71364]: INFO os_vif [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4')
Apr 11 21:59:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No VIF found with MAC fa:16:3e:44:2c:d8, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:59:01 user nova-compute[71364]: INFO nova.compute.manager [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Rescuing
Apr 11 21:59:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquired lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:59:01 user nova-compute[71364]: DEBUG nova.network.neutron [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:59:02 user nova-compute[71364]: DEBUG nova.network.neutron [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Updating instance_info_cache with network_info: [{"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:59:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Releasing lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:59:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:02 user nova-compute[71364]: DEBUG nova.compute.manager [req-8860218c-a546-43d1-9041-508d77e143d7 req-07158c2c-1cb5-47ae-abb7-7939028b5df8 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-vif-unplugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8860218c-a546-43d1-9041-508d77e143d7 req-07158c2c-1cb5-47ae-abb7-7939028b5df8 service nova] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8860218c-a546-43d1-9041-508d77e143d7 req-07158c2c-1cb5-47ae-abb7-7939028b5df8 service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8860218c-a546-43d1-9041-508d77e143d7 req-07158c2c-1cb5-47ae-abb7-7939028b5df8 service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:02 user nova-compute[71364]: DEBUG nova.compute.manager [req-8860218c-a546-43d1-9041-508d77e143d7 req-07158c2c-1cb5-47ae-abb7-7939028b5df8 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] No waiting events found dispatching network-vif-unplugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:02 user nova-compute[71364]: WARNING nova.compute.manager [req-8860218c-a546-43d1-9041-508d77e143d7 req-07158c2c-1cb5-47ae-abb7-7939028b5df8 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received unexpected event network-vif-unplugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance with vm_state active and task_state rescuing.
Apr 11 21:59:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-0231b491-ff1a-44d8-a1a7-ab461c08e8d1 req-3a4b3bc0-8755-4049-ab0b-848926a8c355 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0231b491-ff1a-44d8-a1a7-ab461c08e8d1 req-3a4b3bc0-8755-4049-ab0b-848926a8c355 service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0231b491-ff1a-44d8-a1a7-ab461c08e8d1 req-3a4b3bc0-8755-4049-ab0b-848926a8c355 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0231b491-ff1a-44d8-a1a7-ab461c08e8d1 req-3a4b3bc0-8755-4049-ab0b-848926a8c355 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-0231b491-ff1a-44d8-a1a7-ab461c08e8d1 req-3a4b3bc0-8755-4049-ab0b-848926a8c355 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:03 user nova-compute[71364]: WARNING nova.compute.manager [req-0231b491-ff1a-44d8-a1a7-ab461c08e8d1 req-3a4b3bc0-8755-4049-ab0b-848926a8c355 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state active and task_state resize_finish.
Apr 11 21:59:03 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Instance destroyed successfully.
Apr 11 21:59:03 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Attempting a stable device rescue
Apr 11 21:59:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71364) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Instance directory exists: not creating {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 21:59:03 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Creating image(s)
Apr 11 21:59:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "/opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "/opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "/opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG nova.objects.instance [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'trusted_certs' on Instance uuid c48d8944-6010-4d8d-9761-6ee0d7cd005b {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "476bc793ad533d349fee4a742a2f862e218ed29e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "476bc793ad533d349fee4a742a2f862e218ed29e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e.part --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e.part --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:04 user nova-compute[71364]: DEBUG nova.virt.images [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 8ca0d394-c7d5-48d6-a572-8b6cd6aca54d was qcow2, converting to raw {{(pid=71364) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 21:59:04 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 21:59:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e.part /opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e.converted {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e.part /opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e.converted" returned: 0 in 0.283s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e.converted --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e.converted --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "476bc793ad533d349fee4a742a2f862e218ed29e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.172s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "476bc793ad533d349fee4a742a2f862e218ed29e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "476bc793ad533d349fee4a742a2f862e218ed29e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-2df272cd-f66a-4049-a272-e6a6df178671 req-4a5f877c-960f-4e29-a227-bba385947e56 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2df272cd-f66a-4049-a272-e6a6df178671 req-4a5f877c-960f-4e29-a227-bba385947e56 service nova] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2df272cd-f66a-4049-a272-e6a6df178671 req-4a5f877c-960f-4e29-a227-bba385947e56 service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2df272cd-f66a-4049-a272-e6a6df178671 req-4a5f877c-960f-4e29-a227-bba385947e56 service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-2df272cd-f66a-4049-a272-e6a6df178671 req-4a5f877c-960f-4e29-a227-bba385947e56 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] No waiting events found dispatching network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:05 user nova-compute[71364]: WARNING nova.compute.manager [req-2df272cd-f66a-4049-a272-e6a6df178671 req-4a5f877c-960f-4e29-a227-bba385947e56 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received unexpected event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance with vm_state active and task_state rescuing.
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e,backing_fmt=raw /opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b/disk.rescue {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e,backing_fmt=raw /opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b/disk.rescue" returned: 0 in 0.049s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "476bc793ad533d349fee4a742a2f862e218ed29e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.objects.instance [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'migration_context' on Instance uuid c48d8944-6010-4d8d-9761-6ee0d7cd005b {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Start _get_guest_xml network_info=[{"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "vif_mac": "fa:16:3e:c4:30:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8ca0d394-c7d5-48d6-a572-8b6cd6aca54d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RChlkXFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c48d8944-6010-4d8d-9761-6ee0d7cd005b', 'attached_at': '', 'detached_at': '', 'volume_id': '34069ab4-9b63-44e2-98f1-f518605db084', 'serial': '34069ab4-9b63-44e2-98f1-f518605db084'}, 'attachment_id': 'e0a65067-7ac1-4efc-8d78-70bb45b728b5', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.objects.instance [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'resources' on Instance uuid c48d8944-6010-4d8d-9761-6ee0d7cd005b {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.objects.instance [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'numa_topology' on Instance uuid c48d8944-6010-4d8d-9761-6ee0d7cd005b {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:05 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:59:05 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.objects.instance [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'vcpu_model' on Instance uuid c48d8944-6010-4d8d-9761-6ee0d7cd005b {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RChlkXFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:59:05 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:59:05 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:59:05 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cac8fd5-3925-4b89-8e81-76336c496634]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RChlkXFY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 21:59:05 user nova-compute[71364]: node.name = iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 21:59:05 user nova-compute[71364]: node.tpgt = -1
Apr 11 21:59:05 user nova-compute[71364]: node.startup = automatic
Apr 11 21:59:05 user nova-compute[71364]: node.leading_login = No
Apr 11 21:59:05 user nova-compute[71364]: iface.iscsi_ifacename = default
Apr 11 21:59:05 user nova-compute[71364]: iface.net_ifacename = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.ipaddress = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.prefix_len = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.hwaddress = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.transport_name = tcp
Apr 11 21:59:05 user nova-compute[71364]: iface.initiatorname = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.state = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.vlan_id = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.vlan_priority = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.vlan_state = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.iface_num = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.mtu = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.port = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.bootproto = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.subnet_mask = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.gateway = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.dhcp_alt_client_id = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.dhcp_dns = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.dhcp_learn_iqn = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.dhcp_vendor_id_state = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.dhcp_vendor_id = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.dhcp_slp_da = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.fragmentation = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.gratuitous_arp = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.incoming_forwarding = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.tos_state = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.tos = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.ttl = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.delayed_ack = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.tcp_nagle = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.tcp_wsf_state = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.tcp_wsf = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.tcp_timer_scale = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.tcp_timestamp = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.redirect = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.def_task_mgmt_timeout = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.header_digest = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.data_digest = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.immediate_data = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.initial_r2t = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.data_seq_inorder = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.data_pdu_inorder = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.erl = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.max_receive_data_len = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.first_burst_len = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.max_outstanding_r2t = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.max_burst_len = 0
Apr 11 21:59:05 user nova-compute[71364]: iface.chap_auth = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.bidi_chap = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.strict_login_compliance = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.discovery_auth = <empty>
Apr 11 21:59:05 user nova-compute[71364]: iface.discovery_logout = <empty>
Apr 11 21:59:05 user nova-compute[71364]: node.discovery_address = <empty>
Apr 11 21:59:05 user nova-compute[71364]: node.discovery_port = 0
Apr 11 21:59:05 user nova-compute[71364]: node.discovery_type = static
Apr 11 21:59:05 user nova-compute[71364]: node.session.initial_cmdsn = 0
Apr 11 21:59:05 user nova-compute[71364]: node.session.initial_login_retry_max = 8
Apr 11 21:59:05 user nova-compute[71364]: node.session.xmit_thread_priority = -20
Apr 11 21:59:05 user nova-compute[71364]: node.session.cmds_max = 128
Apr 11 21:59:05 user nova-compute[71364]: node.session.queue_depth = 32
Apr 11 21:59:05 user nova-compute[71364]: node.session.nr_sessions = 1
Apr 11 21:59:05 user nova-compute[71364]: node.session.auth.authmethod = CHAP
Apr 11 21:59:05 user nova-compute[71364]: node.session.auth.username = RChlkXFY
Apr 11 21:59:05 user nova-compute[71364]: node.session.auth.password = ***
Apr 11 21:59:05 user nova-compute[71364]: node.session.auth.username_in = <empty>
Apr 11 21:59:05 user nova-compute[71364]: node.session.auth.password_in = <empty>
Apr 11 21:59:05 user nova-compute[71364]: node.session.auth.chap_algs = MD5
Apr 11 21:59:05 user nova-compute[71364]: node.session.timeo.replacement_timeout = 120
Apr 11 21:59:05 user nova-compute[71364]: node.session.err_timeo.abort_timeout = 15
Apr 11 21:59:05 user nova-compute[71364]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 21:59:05 user nova-compute[71364]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 21:59:05 user nova-compute[71364]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 21:59:05 user nova-compute[71364]: node.session.iscsi.FastAbort = Yes
Apr 11 21:59:05 user nova-compute[71364]: node.session.iscsi.InitialR2T = No
Apr 11 21:59:05 user nova-compute[71364]: node.session.iscsi.ImmediateData = Yes
Apr 11 21:59:05 user nova-compute[71364]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 21:59:05 user nova-compute[71364]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 21:59:05 user nova-compute[71364]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 21:59:05 user nova-compute[71364]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 21:59:05 user nova-compute[71364]: node.session.iscsi.MaxConnections = 1
Apr 11 21:59:05 user nova-compute[71364]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 21:59:05 user nova-compute[71364]: node.session.iscsi.ERL = 0
Apr 11 21:59:05 user nova-compute[71364]: node.session.scan = manual
Apr 11 21:59:05 user nova-compute[71364]: node.session.reopen_max = 0
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].address = 172.16.0.220
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].port = 3260
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].startup = manual
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].tcp.window_size = 524288
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].tcp.type_of_service = 0
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].timeo.logout_timeout = 15
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].timeo.login_timeout = 15
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].timeo.auth_timeout = 45
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].iscsi.DataDigest = None
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].iscsi.IFMarker = No
Apr 11 21:59:05 user nova-compute[71364]: node.conn[0].iscsi.OFMarker = No
Apr 11 21:59:05 user nova-compute[71364]: # END RECORD
Apr 11 21:59:05 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37641b3-b735-480a-8fd9-b26c9c629c4d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f61f01-6221-42af-856d-86a2391333de]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RChlkXFY {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RChlkXFY" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b6035a-3c5c-4d0f-8d6e-d52c0922a7e2]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RChlkXFY'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd259724-ea04-464d-999e-6d13e9e880ee]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f131a864-7dc4-48ca-a021-d0637da5dd5f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:59:05 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:59:05 user nova-compute[71364]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:59:05 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:59:05 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:59:05 user nova-compute[71364]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:59:05 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.134s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] HCTL ('34', '0', '0', 0) found on session 21 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf0989a-bb52-446c-8492-3a6a155ac11b]: (4, ('0 0 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Searching for a device in session 21 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RChlkXFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.155s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] <== connect_volume: return (157ms) {'type': 'block', 'scsi_wwn': '23332613731393337', 'path': '/dev/sdc'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332613731393337', 'path': '/dev/sdc'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1124097939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1124097939',id=21,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53057a8fc17e400e8c26a7dec2c873f9',ramdisk_id='',reservation_id='r-vlygxs0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:57:28Z,user_data=None,user_id='10430313a8b44e6794ca88d30a83c69a',uuid=c48d8944-6010-4d8d-9761-6ee0d7cd005b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "vif_mac": "fa:16:3e:c4:30:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converting VIF {"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "vif_mac": "fa:16:3e:c4:30:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e72bd4f-57') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.objects.instance [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'pci_devices' on Instance uuid c48d8944-6010-4d8d-9761-6ee0d7cd005b {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:59:05 user nova-compute[71364]:   <uuid>c48d8944-6010-4d8d-9761-6ee0d7cd005b</uuid>
Apr 11 21:59:05 user nova-compute[71364]:   <name>instance-00000015</name>
Apr 11 21:59:05 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:59:05 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:59:05 user nova-compute[71364]:   <metadata>
Apr 11 21:59:05 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:59:05 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:59:05 user nova-compute[71364]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1124097939</nova:name>
Apr 11 21:59:05 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:59:05</nova:creationTime>
Apr 11 21:59:05 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:59:05 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:59:05 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:59:05 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:59:05 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:59:05 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:59:05 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:59:05 user nova-compute[71364]:       <nova:owner>
Apr 11 21:59:05 user nova-compute[71364]:         <nova:user uuid="10430313a8b44e6794ca88d30a83c69a">tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member</nova:user>
Apr 11 21:59:05 user nova-compute[71364]:         <nova:project uuid="53057a8fc17e400e8c26a7dec2c873f9">tempest-ServerBootFromVolumeStableRescueTest-1235920472</nova:project>
Apr 11 21:59:05 user nova-compute[71364]:       </nova:owner>
Apr 11 21:59:05 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:59:05 user nova-compute[71364]:       <nova:ports>
Apr 11 21:59:05 user nova-compute[71364]:         <nova:port uuid="8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d">
Apr 11 21:59:05 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 21:59:05 user nova-compute[71364]:         </nova:port>
Apr 11 21:59:05 user nova-compute[71364]:       </nova:ports>
Apr 11 21:59:05 user nova-compute[71364]:     </nova:instance>
Apr 11 21:59:05 user nova-compute[71364]:   </metadata>
Apr 11 21:59:05 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:59:05 user nova-compute[71364]:     <system>
Apr 11 21:59:05 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:59:05 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:59:05 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:59:05 user nova-compute[71364]:       <entry name="serial">c48d8944-6010-4d8d-9761-6ee0d7cd005b</entry>
Apr 11 21:59:05 user nova-compute[71364]:       <entry name="uuid">c48d8944-6010-4d8d-9761-6ee0d7cd005b</entry>
Apr 11 21:59:05 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:59:05 user nova-compute[71364]:     </system>
Apr 11 21:59:05 user nova-compute[71364]:   </sysinfo>
Apr 11 21:59:05 user nova-compute[71364]:   <os>
Apr 11 21:59:05 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:59:05 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:59:05 user nova-compute[71364]:   </os>
Apr 11 21:59:05 user nova-compute[71364]:   <features>
Apr 11 21:59:05 user nova-compute[71364]:     <acpi/>
Apr 11 21:59:05 user nova-compute[71364]:     <apic/>
Apr 11 21:59:05 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:59:05 user nova-compute[71364]:   </features>
Apr 11 21:59:05 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:59:05 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:59:05 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:59:05 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:59:05 user nova-compute[71364]:   </clock>
Apr 11 21:59:05 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:59:05 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:59:05 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:59:05 user nova-compute[71364]:   </cpu>
Apr 11 21:59:05 user nova-compute[71364]:   <devices>
Apr 11 21:59:05 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 21:59:05 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:59:05 user nova-compute[71364]:       <source dev="/dev/sdc"/>
Apr 11 21:59:05 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:59:05 user nova-compute[71364]:       <serial>34069ab4-9b63-44e2-98f1-f518605db084</serial>
Apr 11 21:59:05 user nova-compute[71364]:     </disk>
Apr 11 21:59:05 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:59:05 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:59:05 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b/disk.rescue"/>
Apr 11 21:59:05 user nova-compute[71364]:       <target dev="vdb" bus="virtio"/>
Apr 11 21:59:05 user nova-compute[71364]:       <boot order="1"/>
Apr 11 21:59:05 user nova-compute[71364]:     </disk>
Apr 11 21:59:05 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:59:05 user nova-compute[71364]:       <mac address="fa:16:3e:c4:30:2a"/>
Apr 11 21:59:05 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:59:05 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:59:05 user nova-compute[71364]:       <target dev="tap8e72bd4f-57"/>
Apr 11 21:59:05 user nova-compute[71364]:     </interface>
Apr 11 21:59:05 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:59:05 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b/console.log" append="off"/>
Apr 11 21:59:05 user nova-compute[71364]:     </serial>
Apr 11 21:59:05 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:59:05 user nova-compute[71364]:     <video>
Apr 11 21:59:05 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:59:05 user nova-compute[71364]:     </video>
Apr 11 21:59:05 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:59:05 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:59:05 user nova-compute[71364]:     </rng>
Apr 11 21:59:05 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:59:05 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:59:05 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:59:05 user nova-compute[71364]:     </memballoon>
Apr 11 21:59:05 user nova-compute[71364]:   </devices>
Apr 11 21:59:05 user nova-compute[71364]: </domain>
Apr 11 21:59:05 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:59:05 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Instance destroyed successfully.
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] No VIF found with MAC fa:16:3e:c4:30:2a, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-8330d661-5f93-4197-b9ec-c7187a0071ea req-9c1f5287-ceac-4cba-8ec1-f9ce9b89c764 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8330d661-5f93-4197-b9ec-c7187a0071ea req-9c1f5287-ceac-4cba-8ec1-f9ce9b89c764 service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8330d661-5f93-4197-b9ec-c7187a0071ea req-9c1f5287-ceac-4cba-8ec1-f9ce9b89c764 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8330d661-5f93-4197-b9ec-c7187a0071ea req-9c1f5287-ceac-4cba-8ec1-f9ce9b89c764 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-8330d661-5f93-4197-b9ec-c7187a0071ea req-9c1f5287-ceac-4cba-8ec1-f9ce9b89c764 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:05 user nova-compute[71364]: WARNING nova.compute.manager [req-8330d661-5f93-4197-b9ec-c7187a0071ea req-9c1f5287-ceac-4cba-8ec1-f9ce9b89c764 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state active and task_state resize_finish.
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for 5ff9bbaf-1a5e-4acd-aca3-d956728312cb due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250345.7910454, 5ff9bbaf-1a5e-4acd-aca3-d956728312cb => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:59:05 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] VM Resumed (Lifecycle Event)
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:59:05 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance running successfully.
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Failed to set time: agent not configured {{(pid=71364) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] finish_migration finished successfully. {{(pid=71364) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:59:05 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250345.792459, 5ff9bbaf-1a5e-4acd-aca3-d956728312cb => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:59:05 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] VM Started (Lifecycle Event)
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:59:05 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 21:59:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "9486ebab-256f-4804-8951-c29abca195b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "9486ebab-256f-4804-8951-c29abca195b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "9486ebab-256f-4804-8951-c29abca195b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "9486ebab-256f-4804-8951-c29abca195b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "9486ebab-256f-4804-8951-c29abca195b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:06 user nova-compute[71364]: INFO nova.compute.manager [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Terminating instance
Apr 11 21:59:06 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-1193f704-1ae1-4998-843e-763872cc2539 req-e0a22841-c530-4f2b-bb28-773e4f4e909f service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Received event network-vif-unplugged-7bd93bff-fc7a-41e9-af2b-f68d4c30b806 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1193f704-1ae1-4998-843e-763872cc2539 req-e0a22841-c530-4f2b-bb28-773e4f4e909f service nova] Acquiring lock "9486ebab-256f-4804-8951-c29abca195b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1193f704-1ae1-4998-843e-763872cc2539 req-e0a22841-c530-4f2b-bb28-773e4f4e909f service nova] Lock "9486ebab-256f-4804-8951-c29abca195b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1193f704-1ae1-4998-843e-763872cc2539 req-e0a22841-c530-4f2b-bb28-773e4f4e909f service nova] Lock "9486ebab-256f-4804-8951-c29abca195b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-1193f704-1ae1-4998-843e-763872cc2539 req-e0a22841-c530-4f2b-bb28-773e4f4e909f service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] No waiting events found dispatching network-vif-unplugged-7bd93bff-fc7a-41e9-af2b-f68d4c30b806 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-1193f704-1ae1-4998-843e-763872cc2539 req-e0a22841-c530-4f2b-bb28-773e4f4e909f service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Received event network-vif-unplugged-7bd93bff-fc7a-41e9-af2b-f68d4c30b806 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Instance destroyed successfully.
Apr 11 21:59:06 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lazy-loading 'resources' on Instance uuid 9486ebab-256f-4804-8951-c29abca195b6 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1230566984',display_name='tempest-VolumesNegativeTest-instance-1230566984',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1230566984',id=22,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:57:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0294841cf2b746d3880854c2570a3657',ramdisk_id='',reservation_id='r-jbk85v04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1501095424',owner_user_name='tempest-VolumesNegativeTest-1501095424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:57:24Z,user_data=None,user_id='6b5df01d8bd0454f8ea96a5cdfe0df42',uuid=9486ebab-256f-4804-8951-c29abca195b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "address": "fa:16:3e:6e:bb:a9", "network": {"id": "55e94647-7a05-4146-9aed-8da785afd9f1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2f1c68f95cc4183b127590afce31d0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd93bff-fc", "ovs_interfaceid": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Converting VIF {"id": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "address": "fa:16:3e:6e:bb:a9", "network": {"id": "55e94647-7a05-4146-9aed-8da785afd9f1", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.28", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f2f1c68f95cc4183b127590afce31d0d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bd93bff-fc", "ovs_interfaceid": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:bb:a9,bridge_name='br-int',has_traffic_filtering=True,id=7bd93bff-fc7a-41e9-af2b-f68d4c30b806,network=Network(55e94647-7a05-4146-9aed-8da785afd9f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd93bff-fc') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG os_vif [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:bb:a9,bridge_name='br-int',has_traffic_filtering=True,id=7bd93bff-fc7a-41e9-af2b-f68d4c30b806,network=Network(55e94647-7a05-4146-9aed-8da785afd9f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd93bff-fc') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bd93bff-fc, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:07 user nova-compute[71364]: INFO os_vif [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:bb:a9,bridge_name='br-int',has_traffic_filtering=True,id=7bd93bff-fc7a-41e9-af2b-f68d4c30b806,network=Network(55e94647-7a05-4146-9aed-8da785afd9f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bd93bff-fc')
Apr 11 21:59:07 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Deleting instance files /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6_del
Apr 11 21:59:07 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Deletion of /opt/stack/data/nova/instances/9486ebab-256f-4804-8951-c29abca195b6_del complete
Apr 11 21:59:07 user nova-compute[71364]: INFO nova.compute.manager [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Took 1.04 seconds to destroy the instance on the hypervisor.
Apr 11 21:59:07 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 9486ebab-256f-4804-8951-c29abca195b6] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:59:07 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Took 0.57 seconds to deallocate network for instance.
Apr 11 21:59:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-641772a0-c093-48b4-9220-de8c631ffc95 req-d4d5f253-a688-473d-86dc-b4a06c58610c service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Received event network-vif-deleted-7bd93bff-fc7a-41e9-af2b-f68d4c30b806 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-bbb0127a-c176-4a31-9dd5-b13f8f55df8a req-184260d2-0d92-40a9-9da8-d28d0d839bca service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bbb0127a-c176-4a31-9dd5-b13f8f55df8a req-184260d2-0d92-40a9-9da8-d28d0d839bca service nova] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bbb0127a-c176-4a31-9dd5-b13f8f55df8a req-184260d2-0d92-40a9-9da8-d28d0d839bca service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bbb0127a-c176-4a31-9dd5-b13f8f55df8a req-184260d2-0d92-40a9-9da8-d28d0d839bca service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-bbb0127a-c176-4a31-9dd5-b13f8f55df8a req-184260d2-0d92-40a9-9da8-d28d0d839bca service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] No waiting events found dispatching network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:07 user nova-compute[71364]: WARNING nova.compute.manager [req-bbb0127a-c176-4a31-9dd5-b13f8f55df8a req-184260d2-0d92-40a9-9da8-d28d0d839bca service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received unexpected event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance with vm_state active and task_state rescuing.
Apr 11 21:59:08 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:59:08 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:59:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:08 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Deleted allocations for instance 9486ebab-256f-4804-8951-c29abca195b6
Apr 11 21:59:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "9486ebab-256f-4804-8951-c29abca195b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.325s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-52c8146d-aee8-4f6c-8dab-7171a17568e4 req-286d0fd9-c037-42f0-bb7d-8794a1cc2e19 service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Received event network-vif-plugged-7bd93bff-fc7a-41e9-af2b-f68d4c30b806 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-52c8146d-aee8-4f6c-8dab-7171a17568e4 req-286d0fd9-c037-42f0-bb7d-8794a1cc2e19 service nova] Acquiring lock "9486ebab-256f-4804-8951-c29abca195b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-52c8146d-aee8-4f6c-8dab-7171a17568e4 req-286d0fd9-c037-42f0-bb7d-8794a1cc2e19 service nova] Lock "9486ebab-256f-4804-8951-c29abca195b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-52c8146d-aee8-4f6c-8dab-7171a17568e4 req-286d0fd9-c037-42f0-bb7d-8794a1cc2e19 service nova] Lock "9486ebab-256f-4804-8951-c29abca195b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-52c8146d-aee8-4f6c-8dab-7171a17568e4 req-286d0fd9-c037-42f0-bb7d-8794a1cc2e19 service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] No waiting events found dispatching network-vif-plugged-7bd93bff-fc7a-41e9-af2b-f68d4c30b806 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:08 user nova-compute[71364]: WARNING nova.compute.manager [req-52c8146d-aee8-4f6c-8dab-7171a17568e4 req-286d0fd9-c037-42f0-bb7d-8794a1cc2e19 service nova] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Received unexpected event network-vif-plugged-7bd93bff-fc7a-41e9-af2b-f68d4c30b806 for instance with vm_state deleted and task_state None.
Apr 11 21:59:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for c48d8944-6010-4d8d-9761-6ee0d7cd005b due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250349.6909454, c48d8944-6010-4d8d-9761-6ee0d7cd005b => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:59:09 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] VM Resumed (Lifecycle Event)
Apr 11 21:59:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG nova.objects.instance [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'flavor' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:59:09 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 21:59:09 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250349.6969876, c48d8944-6010-4d8d-9761-6ee0d7cd005b => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:59:09 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] VM Started (Lifecycle Event)
Apr 11 21:59:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-changed-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Refreshing instance network info cache due to event network-changed-914c7aea-325c-4061-893a-353590f63b84. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] Acquiring lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] Acquired lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG nova.network.neutron [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Refreshing network info cache for port 914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:09 user nova-compute[71364]: INFO nova.compute.manager [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Attaching volume 594600b9-5a65-44f7-9a8c-c741f0ef19fe to /dev/vdb
Apr 11 21:59:10 user nova-compute[71364]: DEBUG os_brick.utils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f682434-b085-43f1-8da7-3513eb68ac28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[425cdf44-b923-4051-a6b7-fdd611c014c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b21d1d6-f5f6-4df6-bef8-f85b61cc6d83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c8ff12-ce1c-4647-97f7-2d0a406545bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:59:10 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f6b8ec-fc7d-439f-ac94-bf401560ab28]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG os_brick.utils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Updating existing volume attachment record: 3c657777-a966-4b24-b0f8-3f0659bf9627 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG nova.network.neutron [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Updated VIF entry in instance network info cache for port 914c7aea-325c-4061-893a-353590f63b84. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG nova.network.neutron [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Updating instance_info_cache with network_info: [{"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] Releasing lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG nova.compute.manager [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:10 user nova-compute[71364]: DEBUG nova.compute.manager [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] No waiting events found dispatching network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:10 user nova-compute[71364]: WARNING nova.compute.manager [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received unexpected event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance with vm_state rescued and task_state None.
Apr 11 21:59:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMYJtIcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:59:14 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:59:14 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:59:14 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1a5f07-0fb5-4bc8-99d3-c57aee3432fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:59:14 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88bfac4-97f8-48e9-b1e1-903633fc3070]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe] added
Apr 11 21:59:14 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e5e074-be15-4f1d-980f-75b6b89e5279]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d287e2-05fd-4fa4-a3d7-c654445c6c9c]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMYJtIcb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMYJtIcb" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c34c21-6673-4168-8cf0-ad1d24fcd1b2]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BMYJtIcb'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ea5203-95e7-4614-ab1e-3f86a96b4c1e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[474bfd0a-8af4-409f-bf4a-331ccbd02a88]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:59:14 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:59:14 user nova-compute[71364]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:59:14 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:59:14 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:59:14 user nova-compute[71364]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:59:14 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0086707e-a922-4404-8658-ae2346d88774]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260]
Apr 11 21:59:14 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260] successful.
Apr 11 21:59:14 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86d332f-6d5f-4f8e-b2a1-a4fbcf9a9f63]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:14 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:15 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[894cd293-bd16-41be-bde7-35790abdb600]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:15 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:59:15 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:59:15 user nova-compute[71364]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:59:15 user nova-compute[71364]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 21:59:15 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:59:15 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:59:15 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:59:15 user nova-compute[71364]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:59:15 user nova-compute[71364]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 21:59:15 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:59:15 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:59:15 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:59:15 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:59:15 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:59:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:15 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[755544ad-90d8-406f-a91e-eba6c5dc900c]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:15 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: None {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:59:16 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:59:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMYJtIcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:59:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:59:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23165363164316237', 'path': '/dev/sde'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:59:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165363164316237', 'path': '/dev/sde'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:59:16 user nova-compute[71364]: DEBUG nova.objects.instance [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'flavor' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 21:59:16 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:59:16 user nova-compute[71364]:   <source dev="/dev/sde"/>
Apr 11 21:59:16 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 21:59:16 user nova-compute[71364]:   <serial>594600b9-5a65-44f7-9a8c-c741f0ef19fe</serial>
Apr 11 21:59:16 user nova-compute[71364]: </disk>
Apr 11 21:59:16 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 21:59:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:59:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:59:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] No VIF found with MAC fa:16:3e:fb:64:5e, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:59:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.635s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bde86374-1766-4e64-aba5-5d8cbe30fec0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bde86374-1766-4e64-aba5-5d8cbe30fec0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:17 user nova-compute[71364]: DEBUG nova.compute.manager [None req-bde86374-1766-4e64-aba5-5d8cbe30fec0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:17 user nova-compute[71364]: DEBUG nova.compute.manager [None req-bde86374-1766-4e64-aba5-5d8cbe30fec0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71364) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 11 21:59:17 user nova-compute[71364]: DEBUG nova.objects.instance [None req-bde86374-1766-4e64-aba5-5d8cbe30fec0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'flavor' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-d9e0ebaf-4bca-4cd0-9d79-aa72783653e6 req-680e5250-6458-4669-ac25-b7bbb3a48777 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d9e0ebaf-4bca-4cd0-9d79-aa72783653e6 req-680e5250-6458-4669-ac25-b7bbb3a48777 service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d9e0ebaf-4bca-4cd0-9d79-aa72783653e6 req-680e5250-6458-4669-ac25-b7bbb3a48777 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d9e0ebaf-4bca-4cd0-9d79-aa72783653e6 req-680e5250-6458-4669-ac25-b7bbb3a48777 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-d9e0ebaf-4bca-4cd0-9d79-aa72783653e6 req-680e5250-6458-4669-ac25-b7bbb3a48777 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:18 user nova-compute[71364]: WARNING nova.compute.manager [req-d9e0ebaf-4bca-4cd0-9d79-aa72783653e6 req-680e5250-6458-4669-ac25-b7bbb3a48777 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state active and task_state powering-off.
Apr 11 21:59:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:18 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Instance destroyed successfully.
Apr 11 21:59:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-bde86374-1766-4e64-aba5-5d8cbe30fec0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bde86374-1766-4e64-aba5-5d8cbe30fec0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.882s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:19 user nova-compute[71364]: INFO nova.compute.manager [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Rescuing
Apr 11 21:59:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:59:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquired lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:59:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:59:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Updating instance_info_cache with network_info: [{"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:59:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Releasing lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:59:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:20 user nova-compute[71364]: WARNING nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state stopped and task_state None.
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:20 user nova-compute[71364]: WARNING nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state stopped and task_state None.
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:20 user nova-compute[71364]: WARNING nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state stopped and task_state None.
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:20 user nova-compute[71364]: WARNING nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state stopped and task_state None.
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:20 user nova-compute[71364]: WARNING nova.compute.manager [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state stopped and task_state None.
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-9ececdac-ea5d-4d5c-8d76-251965c3ed45 req-fcbd7260-377f-4135-b8f9-b5e39a19bf16 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-vif-unplugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9ececdac-ea5d-4d5c-8d76-251965c3ed45 req-fcbd7260-377f-4135-b8f9-b5e39a19bf16 service nova] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9ececdac-ea5d-4d5c-8d76-251965c3ed45 req-fcbd7260-377f-4135-b8f9-b5e39a19bf16 service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9ececdac-ea5d-4d5c-8d76-251965c3ed45 req-fcbd7260-377f-4135-b8f9-b5e39a19bf16 service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-9ececdac-ea5d-4d5c-8d76-251965c3ed45 req-fcbd7260-377f-4135-b8f9-b5e39a19bf16 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] No waiting events found dispatching network-vif-unplugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:20 user nova-compute[71364]: WARNING nova.compute.manager [req-9ececdac-ea5d-4d5c-8d76-251965c3ed45 req-fcbd7260-377f-4135-b8f9-b5e39a19bf16 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received unexpected event network-vif-unplugged-809749e4-0885-4825-8976-660b2c0bcca7 for instance with vm_state active and task_state rescuing.
Apr 11 21:59:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:20 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Instance destroyed successfully.
Apr 11 21:59:20 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Attempting rescue
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71364) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Instance directory exists: not creating {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 21:59:20 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Creating image(s)
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "/opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "/opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "/opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.objects.instance [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'trusted_certs' on Instance uuid b66951a9-73f3-41ce-9f19-b4e5e24d61b0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.rescue {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.rescue" returned: 0 in 0.048s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.objects.instance [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'migration_context' on Instance uuid b66951a9-73f3-41ce-9f19-b4e5e24d61b0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Start _get_guest_xml network_info=[{"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "vif_mac": "fa:16:3e:4a:7c:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.objects.instance [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'resources' on Instance uuid b66951a9-73f3-41ce-9f19-b4e5e24d61b0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.objects.instance [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'numa_topology' on Instance uuid b66951a9-73f3-41ce-9f19-b4e5e24d61b0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:20 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:59:20 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.objects.instance [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'vcpu_model' on Instance uuid b66951a9-73f3-41ce-9f19-b4e5e24d61b0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1390553747',display_name='tempest-ServerRescueNegativeTestJSON-server-1390553747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1390553747',id=17,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:54:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c35707743988462887127e06825cd483',ramdisk_id='',reservation_id='r-taxw1lk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-797099247',owner_user_name='tempest-ServerRescueNegativeTestJSON-797099247-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:54:45Z,user_data=None,user_id='546f0a94a2ad450ead596252c786839e',uuid=b66951a9-73f3-41ce-9f19-b4e5e24d61b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "vif_mac": "fa:16:3e:4a:7c:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converting VIF {"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "vif_mac": "fa:16:3e:4a:7c:1e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:7c:1e,bridge_name='br-int',has_traffic_filtering=True,id=809749e4-0885-4825-8976-660b2c0bcca7,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809749e4-08') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.objects.instance [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'pci_devices' on Instance uuid b66951a9-73f3-41ce-9f19-b4e5e24d61b0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:59:20 user nova-compute[71364]:   <uuid>b66951a9-73f3-41ce-9f19-b4e5e24d61b0</uuid>
Apr 11 21:59:20 user nova-compute[71364]:   <name>instance-00000011</name>
Apr 11 21:59:20 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:59:20 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:59:20 user nova-compute[71364]:   <metadata>
Apr 11 21:59:20 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:59:20 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:59:20 user nova-compute[71364]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1390553747</nova:name>
Apr 11 21:59:20 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:59:20</nova:creationTime>
Apr 11 21:59:20 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:59:20 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:59:20 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:59:20 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:59:20 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:59:20 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:59:20 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:59:20 user nova-compute[71364]:       <nova:owner>
Apr 11 21:59:20 user nova-compute[71364]:         <nova:user uuid="546f0a94a2ad450ead596252c786839e">tempest-ServerRescueNegativeTestJSON-797099247-project-member</nova:user>
Apr 11 21:59:20 user nova-compute[71364]:         <nova:project uuid="c35707743988462887127e06825cd483">tempest-ServerRescueNegativeTestJSON-797099247</nova:project>
Apr 11 21:59:20 user nova-compute[71364]:       </nova:owner>
Apr 11 21:59:20 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 21:59:20 user nova-compute[71364]:       <nova:ports>
Apr 11 21:59:20 user nova-compute[71364]:         <nova:port uuid="809749e4-0885-4825-8976-660b2c0bcca7">
Apr 11 21:59:20 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 21:59:20 user nova-compute[71364]:         </nova:port>
Apr 11 21:59:20 user nova-compute[71364]:       </nova:ports>
Apr 11 21:59:20 user nova-compute[71364]:     </nova:instance>
Apr 11 21:59:20 user nova-compute[71364]:   </metadata>
Apr 11 21:59:20 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:59:20 user nova-compute[71364]:     <system>
Apr 11 21:59:20 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:59:20 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:59:20 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:59:20 user nova-compute[71364]:       <entry name="serial">b66951a9-73f3-41ce-9f19-b4e5e24d61b0</entry>
Apr 11 21:59:20 user nova-compute[71364]:       <entry name="uuid">b66951a9-73f3-41ce-9f19-b4e5e24d61b0</entry>
Apr 11 21:59:20 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:59:20 user nova-compute[71364]:     </system>
Apr 11 21:59:20 user nova-compute[71364]:   </sysinfo>
Apr 11 21:59:20 user nova-compute[71364]:   <os>
Apr 11 21:59:20 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:59:20 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:59:20 user nova-compute[71364]:   </os>
Apr 11 21:59:20 user nova-compute[71364]:   <features>
Apr 11 21:59:20 user nova-compute[71364]:     <acpi/>
Apr 11 21:59:20 user nova-compute[71364]:     <apic/>
Apr 11 21:59:20 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:59:20 user nova-compute[71364]:   </features>
Apr 11 21:59:20 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:59:20 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:59:20 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:59:20 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:59:20 user nova-compute[71364]:   </clock>
Apr 11 21:59:20 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:59:20 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:59:20 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:59:20 user nova-compute[71364]:   </cpu>
Apr 11 21:59:20 user nova-compute[71364]:   <devices>
Apr 11 21:59:20 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:59:20 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:59:20 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.rescue"/>
Apr 11 21:59:20 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:59:20 user nova-compute[71364]:     </disk>
Apr 11 21:59:20 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 21:59:20 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 21:59:20 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk"/>
Apr 11 21:59:20 user nova-compute[71364]:       <target dev="vdb" bus="virtio"/>
Apr 11 21:59:20 user nova-compute[71364]:     </disk>
Apr 11 21:59:20 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:59:20 user nova-compute[71364]:       <mac address="fa:16:3e:4a:7c:1e"/>
Apr 11 21:59:20 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:59:20 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:59:20 user nova-compute[71364]:       <target dev="tap809749e4-08"/>
Apr 11 21:59:20 user nova-compute[71364]:     </interface>
Apr 11 21:59:20 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:59:20 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/console.log" append="off"/>
Apr 11 21:59:20 user nova-compute[71364]:     </serial>
Apr 11 21:59:20 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:59:20 user nova-compute[71364]:     <video>
Apr 11 21:59:20 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:59:20 user nova-compute[71364]:     </video>
Apr 11 21:59:20 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:59:20 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:59:20 user nova-compute[71364]:     </rng>
Apr 11 21:59:20 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:59:20 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:59:20 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:59:20 user nova-compute[71364]:     </memballoon>
Apr 11 21:59:20 user nova-compute[71364]:   </devices>
Apr 11 21:59:20 user nova-compute[71364]: </domain>
Apr 11 21:59:20 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:59:20 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Instance destroyed successfully.
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:59:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No VIF found with MAC fa:16:3e:4a:7c:1e, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:59:21 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250346.9640946, 9486ebab-256f-4804-8951-c29abca195b6 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:59:21 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 9486ebab-256f-4804-8951-c29abca195b6] VM Stopped (Lifecycle Event)
Apr 11 21:59:21 user nova-compute[71364]: DEBUG nova.compute.manager [None req-168512c4-dce8-4214-85c2-fd0979da9f9e None None] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-6c90e959-0a88-4b58-a47b-977c06215a23 req-a9cc4d74-ec49-4c1e-95e1-03e0ec3ff2e2 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6c90e959-0a88-4b58-a47b-977c06215a23 req-a9cc4d74-ec49-4c1e-95e1-03e0ec3ff2e2 service nova] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6c90e959-0a88-4b58-a47b-977c06215a23 req-a9cc4d74-ec49-4c1e-95e1-03e0ec3ff2e2 service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6c90e959-0a88-4b58-a47b-977c06215a23 req-a9cc4d74-ec49-4c1e-95e1-03e0ec3ff2e2 service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-6c90e959-0a88-4b58-a47b-977c06215a23 req-a9cc4d74-ec49-4c1e-95e1-03e0ec3ff2e2 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] No waiting events found dispatching network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:22 user nova-compute[71364]: WARNING nova.compute.manager [req-6c90e959-0a88-4b58-a47b-977c06215a23 req-a9cc4d74-ec49-4c1e-95e1-03e0ec3ff2e2 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received unexpected event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 for instance with vm_state active and task_state rescuing.
Apr 11 21:59:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] No waiting events found dispatching network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:24 user nova-compute[71364]: WARNING nova.compute.manager [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received unexpected event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 for instance with vm_state active and task_state rescuing.
Apr 11 21:59:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] No waiting events found dispatching network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:24 user nova-compute[71364]: WARNING nova.compute.manager [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received unexpected event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 for instance with vm_state active and task_state rescuing.
Apr 11 21:59:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for b66951a9-73f3-41ce-9f19-b4e5e24d61b0 due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 21:59:24 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250364.4690714, b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:59:24 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] VM Resumed (Lifecycle Event)
Apr 11 21:59:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:59:24 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 21:59:24 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250364.4730392, b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:59:24 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] VM Started (Lifecycle Event)
Apr 11 21:59:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:59:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:33 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250358.4777584, 53530e4f-a899-496d-8b83-a3b5f7dbc7ea => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:59:33 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] VM Stopped (Lifecycle Event)
Apr 11 21:59:33 user nova-compute[71364]: DEBUG nova.compute.manager [None req-40733074-8a11-4007-954f-a7e8ab470617 None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:33 user nova-compute[71364]: DEBUG nova.compute.manager [None req-40733074-8a11-4007-954f-a7e8ab470617 None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:59:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "3915859d-4e2f-4568-9b02-d0733a474749" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:40 user nova-compute[71364]: INFO nova.compute.manager [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Unshelving
Apr 11 21:59:40 user nova-compute[71364]: INFO nova.virt.block_device [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Booting with volume f165ecee-978a-47fa-a8ae-bee74bf26b44 at /dev/vda
Apr 11 21:59:40 user nova-compute[71364]: DEBUG os_brick.utils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c9094a-e081-43da-a866-ff76aec7637e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c9fcc4-9956-4ff6-9e4f-51860659f0f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1acb1c5-057a-4a50-aa5b-74a527b8b287]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bd2d57-48b3-461d-a010-d91bf27051cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 21:59:40 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 21:59:40 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[533faa8a-7ba9-49a5-bcdd-1c14cd099a54]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG os_brick.utils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:59:40 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updating existing volume attachment record: 11eecad1-a7a2-491c-99cd-3c7df63afcc6 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 21:59:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:45 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lazy-loading 'pci_requests' on Instance uuid 3915859d-4e2f-4568-9b02-d0733a474749 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:45 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lazy-loading 'numa_topology' on Instance uuid 3915859d-4e2f-4568-9b02-d0733a474749 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:45 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:59:45 user nova-compute[71364]: INFO nova.compute.claims [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Claim successful on node user
Apr 11 21:59:45 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:59:45 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:59:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:45 user nova-compute[71364]: INFO nova.network.neutron [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updating port 5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquired lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.network.neutron [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.compute.manager [req-9292b272-a0aa-4881-8147-763ddd11c2dc req-3b067f1a-b765-4690-8b2f-bfb11316ae81 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-changed-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.compute.manager [req-9292b272-a0aa-4881-8147-763ddd11c2dc req-3b067f1a-b765-4690-8b2f-bfb11316ae81 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Refreshing instance network info cache due to event network-changed-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9292b272-a0aa-4881-8147-763ddd11c2dc req-3b067f1a-b765-4690-8b2f-bfb11316ae81 service nova] Acquiring lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.network.neutron [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updating instance_info_cache with network_info: [{"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Releasing lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:59:46 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Creating image(s)
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Ensure instance console log exists: /opt/stack/data/nova/instances/3915859d-4e2f-4568-9b02-d0733a474749/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Start _get_guest_xml network_info=[{"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQEUSMDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3915859d-4e2f-4568-9b02-d0733a474749', 'attached_at': '', 'detached_at': '', 'volume_id': 'f165ecee-978a-47fa-a8ae-bee74bf26b44', 'serial': 'f165ecee-978a-47fa-a8ae-bee74bf26b44'}, 'attachment_id': '11eecad1-a7a2-491c-99cd-3c7df63afcc6', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9292b272-a0aa-4881-8147-763ddd11c2dc req-3b067f1a-b765-4690-8b2f-bfb11316ae81 service nova] Acquired lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.network.neutron [req-9292b272-a0aa-4881-8147-763ddd11c2dc req-3b067f1a-b765-4690-8b2f-bfb11316ae81 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Refreshing network info cache for port 5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 21:59:46 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:59:46 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3915859d-4e2f-4568-9b02-d0733a474749 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQEUSMDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 21:59:46 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:59:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:59:46 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 21:59:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 21:59:46 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[538d4b07-c7f1-4526-a19c-21e67fd2832c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 21:59:46 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b6d12-95a1-43d4-a637-eba700086f59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44] added
Apr 11 21:59:46 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c664380-933b-4568-b052-f5d3ef04eb56]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:46 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd70231-67cf-4409-b80f-cf1c8fcb654b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yQEUSMDw {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yQEUSMDw" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee8a5c3-2c0e-41cc-bddb-b2a781fcd7bb]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yQEUSMDw'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[03946a10-f63c-4a7e-a93a-e1f636553352]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f8cc61-2d86-49b6-91b9-62fd314d246c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:59:47 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:59:47 user nova-compute[71364]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:59:47 user nova-compute[71364]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 21:59:47 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:59:47 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:59:47 user nova-compute[71364]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:59:47 user nova-compute[71364]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 21:59:47 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7fb77f-7f64-4b3c-9cad-e1a21d0b4a2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260]
Apr 11 21:59:47 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260] successful.
Apr 11 21:59:47 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[684e939c-1ca9-4be2-8f26-f610eb2f4301]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d878e813-e2e8-4923-b1a9-f8bde51e848a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:59:47 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:59:47 user nova-compute[71364]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:59:47 user nova-compute[71364]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 21:59:47 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:59:47 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 21:59:47 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 21:59:47 user nova-compute[71364]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 21:59:47 user nova-compute[71364]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 21:59:47 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 21:59:47 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] HCTL ('37', '-', '-', 0) found on session 26 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c91f8e9-2d4c-46ae-90a5-1e9cc4c2eec9]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Searching for a device in session 26 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQEUSMDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG nova.network.neutron [req-9292b272-a0aa-4881-8147-763ddd11c2dc req-3b067f1a-b765-4690-8b2f-bfb11316ae81 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updated VIF entry in instance network info cache for port 5ea4b5fb-b111-488e-b1e4-15e0a63b3b83. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG nova.network.neutron [req-9292b272-a0aa-4881-8147-763ddd11c2dc req-3b067f1a-b765-4690-8b2f-bfb11316ae81 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updating instance_info_cache with network_info: [{"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:59:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9292b272-a0aa-4881-8147-763ddd11c2dc req-3b067f1a-b765-4690-8b2f-bfb11316ae81 service nova] Releasing lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23434333266353538', 'path': '/dev/sdf'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434333266353538', 'path': '/dev/sdf'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T21:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-115257149',display_name='tempest-TestShelveInstance-server-115257149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-115257149',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-413583393',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:56:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6204710ef9e04099a7397acd2b027f15',ramdisk_id='',reservation_id='r-4z4pjiv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2116780630',owner_user_name='tempest-TestShelveInstance-2116780630-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:59:41Z,user_data=None,user_id='f1eb9c1fa13245dfbf9cdecd163e8e21',uuid=3915859d-4e2f-4568-9b02-d0733a474749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Converting VIF {"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83,network=Network(2fa04b01-8810-4143-8c46-44a06e013c98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea4b5fb-b1') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lazy-loading 'pci_devices' on Instance uuid 3915859d-4e2f-4568-9b02-d0733a474749 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] End _get_guest_xml xml=<domain type="kvm">
Apr 11 21:59:48 user nova-compute[71364]:   <uuid>3915859d-4e2f-4568-9b02-d0733a474749</uuid>
Apr 11 21:59:48 user nova-compute[71364]:   <name>instance-00000013</name>
Apr 11 21:59:48 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 21:59:48 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 21:59:48 user nova-compute[71364]:   <metadata>
Apr 11 21:59:48 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 21:59:48 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 21:59:48 user nova-compute[71364]:       <nova:name>tempest-TestShelveInstance-server-115257149</nova:name>
Apr 11 21:59:48 user nova-compute[71364]:       <nova:creationTime>2023-04-11 21:59:46</nova:creationTime>
Apr 11 21:59:48 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 21:59:48 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 21:59:48 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 21:59:48 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 21:59:48 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 21:59:48 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 21:59:48 user nova-compute[71364]:       </nova:flavor>
Apr 11 21:59:48 user nova-compute[71364]:       <nova:owner>
Apr 11 21:59:48 user nova-compute[71364]:         <nova:user uuid="f1eb9c1fa13245dfbf9cdecd163e8e21">tempest-TestShelveInstance-2116780630-project-member</nova:user>
Apr 11 21:59:48 user nova-compute[71364]:         <nova:project uuid="6204710ef9e04099a7397acd2b027f15">tempest-TestShelveInstance-2116780630</nova:project>
Apr 11 21:59:48 user nova-compute[71364]:       </nova:owner>
Apr 11 21:59:48 user nova-compute[71364]:       <nova:ports>
Apr 11 21:59:48 user nova-compute[71364]:         <nova:port uuid="5ea4b5fb-b111-488e-b1e4-15e0a63b3b83">
Apr 11 21:59:48 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 21:59:48 user nova-compute[71364]:         </nova:port>
Apr 11 21:59:48 user nova-compute[71364]:       </nova:ports>
Apr 11 21:59:48 user nova-compute[71364]:     </nova:instance>
Apr 11 21:59:48 user nova-compute[71364]:   </metadata>
Apr 11 21:59:48 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 21:59:48 user nova-compute[71364]:     <system>
Apr 11 21:59:48 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 21:59:48 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 21:59:48 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 21:59:48 user nova-compute[71364]:       <entry name="serial">3915859d-4e2f-4568-9b02-d0733a474749</entry>
Apr 11 21:59:48 user nova-compute[71364]:       <entry name="uuid">3915859d-4e2f-4568-9b02-d0733a474749</entry>
Apr 11 21:59:48 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 21:59:48 user nova-compute[71364]:     </system>
Apr 11 21:59:48 user nova-compute[71364]:   </sysinfo>
Apr 11 21:59:48 user nova-compute[71364]:   <os>
Apr 11 21:59:48 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 21:59:48 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 21:59:48 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 21:59:48 user nova-compute[71364]:   </os>
Apr 11 21:59:48 user nova-compute[71364]:   <features>
Apr 11 21:59:48 user nova-compute[71364]:     <acpi/>
Apr 11 21:59:48 user nova-compute[71364]:     <apic/>
Apr 11 21:59:48 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 21:59:48 user nova-compute[71364]:   </features>
Apr 11 21:59:48 user nova-compute[71364]:   <clock offset="utc">
Apr 11 21:59:48 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 21:59:48 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 21:59:48 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 21:59:48 user nova-compute[71364]:   </clock>
Apr 11 21:59:48 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 21:59:48 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 21:59:48 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 21:59:48 user nova-compute[71364]:   </cpu>
Apr 11 21:59:48 user nova-compute[71364]:   <devices>
Apr 11 21:59:48 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 21:59:48 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 21:59:48 user nova-compute[71364]:       <source dev="/dev/sdf"/>
Apr 11 21:59:48 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 21:59:48 user nova-compute[71364]:       <serial>f165ecee-978a-47fa-a8ae-bee74bf26b44</serial>
Apr 11 21:59:48 user nova-compute[71364]:     </disk>
Apr 11 21:59:48 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 21:59:48 user nova-compute[71364]:       <mac address="fa:16:3e:69:cd:e6"/>
Apr 11 21:59:48 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:59:48 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 21:59:48 user nova-compute[71364]:       <target dev="tap5ea4b5fb-b1"/>
Apr 11 21:59:48 user nova-compute[71364]:     </interface>
Apr 11 21:59:48 user nova-compute[71364]:     <serial type="pty">
Apr 11 21:59:48 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/3915859d-4e2f-4568-9b02-d0733a474749/console.log" append="off"/>
Apr 11 21:59:48 user nova-compute[71364]:     </serial>
Apr 11 21:59:48 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 21:59:48 user nova-compute[71364]:     <video>
Apr 11 21:59:48 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 21:59:48 user nova-compute[71364]:     </video>
Apr 11 21:59:48 user nova-compute[71364]:     <rng model="virtio">
Apr 11 21:59:48 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 21:59:48 user nova-compute[71364]:     </rng>
Apr 11 21:59:48 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 21:59:48 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 21:59:48 user nova-compute[71364]:       <stats period="10"/>
Apr 11 21:59:48 user nova-compute[71364]:     </memballoon>
Apr 11 21:59:48 user nova-compute[71364]:   </devices>
Apr 11 21:59:48 user nova-compute[71364]: </domain>
Apr 11 21:59:48 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T21:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-115257149',display_name='tempest-TestShelveInstance-server-115257149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-115257149',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-413583393',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:56:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6204710ef9e04099a7397acd2b027f15',ramdisk_id='',reservation_id='r-4z4pjiv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2116780630',owner_user_name='tempest-TestShelveInstance-2116780630-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:59:41Z,user_data=None,user_id='f1eb9c1fa13245dfbf9cdecd163e8e21',uuid=3915859d-4e2f-4568-9b02-d0733a474749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Converting VIF {"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83,network=Network(2fa04b01-8810-4143-8c46-44a06e013c98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea4b5fb-b1') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG os_vif [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83,network=Network(2fa04b01-8810-4143-8c46-44a06e013c98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea4b5fb-b1') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ea4b5fb-b1, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ea4b5fb-b1, col_values=(('external_ids', {'iface-id': '5ea4b5fb-b111-488e-b1e4-15e0a63b3b83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:cd:e6', 'vm-uuid': '3915859d-4e2f-4568-9b02-d0733a474749'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:48 user nova-compute[71364]: INFO os_vif [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83,network=Network(2fa04b01-8810-4143-8c46-44a06e013c98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea4b5fb-b1')
Apr 11 21:59:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 21:59:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] No VIF found with MAC fa:16:3e:69:cd:e6, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 21:59:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-c42c3722-6d7d-4cc5-904e-8968b01ccceb req-e911ad6d-025f-4875-82cb-44b706ff054c service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c42c3722-6d7d-4cc5-904e-8968b01ccceb req-e911ad6d-025f-4875-82cb-44b706ff054c service nova] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c42c3722-6d7d-4cc5-904e-8968b01ccceb req-e911ad6d-025f-4875-82cb-44b706ff054c service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c42c3722-6d7d-4cc5-904e-8968b01ccceb req-e911ad6d-025f-4875-82cb-44b706ff054c service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-c42c3722-6d7d-4cc5-904e-8968b01ccceb req-e911ad6d-025f-4875-82cb-44b706ff054c service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] No waiting events found dispatching network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:49 user nova-compute[71364]: WARNING nova.compute.manager [req-c42c3722-6d7d-4cc5-904e-8968b01ccceb req-e911ad6d-025f-4875-82cb-44b706ff054c service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received unexpected event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 21:59:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:51 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250391.8196669, 3915859d-4e2f-4568-9b02-d0733a474749 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:59:51 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] VM Resumed (Lifecycle Event)
Apr 11 21:59:51 user nova-compute[71364]: DEBUG nova.compute.manager [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 21:59:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 21:59:51 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Instance spawned successfully.
Apr 11 21:59:51 user nova-compute[71364]: DEBUG nova.compute.manager [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:51 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:51 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:59:51 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:59:51 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250391.8233025, 3915859d-4e2f-4568-9b02-d0733a474749 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 21:59:51 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] VM Started (Lifecycle Event)
Apr 11 21:59:51 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 21:59:51 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 21:59:51 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 21:59:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "3915859d-4e2f-4568-9b02-d0733a474749" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.406s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-1a623562-a6cf-49f1-9cc9-af81ef7529f9 req-a693c8a1-c98e-4791-a7ea-7822586f2abe service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a623562-a6cf-49f1-9cc9-af81ef7529f9 req-a693c8a1-c98e-4791-a7ea-7822586f2abe service nova] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a623562-a6cf-49f1-9cc9-af81ef7529f9 req-a693c8a1-c98e-4791-a7ea-7822586f2abe service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a623562-a6cf-49f1-9cc9-af81ef7529f9 req-a693c8a1-c98e-4791-a7ea-7822586f2abe service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-1a623562-a6cf-49f1-9cc9-af81ef7529f9 req-a693c8a1-c98e-4791-a7ea-7822586f2abe service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] No waiting events found dispatching network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 21:59:52 user nova-compute[71364]: WARNING nova.compute.manager [req-1a623562-a6cf-49f1-9cc9-af81ef7529f9 req-a693c8a1-c98e-4791-a7ea-7822586f2abe service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received unexpected event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance with vm_state active and task_state None.
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:56 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:59:56 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 21:59:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7743MB free_disk=26.16714859008789GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Applying migration context for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb as it has an incoming, in-progress migration 01a865c7-bab2-4298-9a39-2b17a34890c5. Migration status is finished {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 21:59:56 user nova-compute[71364]: INFO nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating resource usage from migration 01a865c7-bab2-4298-9a39-2b17a34890c5
Apr 11 21:59:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Migration 01a865c7-bab2-4298-9a39-2b17a34890c5 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3915859d-4e2f-4568-9b02-d0733a474749 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 21:59:56 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 21:59:57 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:59:57 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:59:57 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 21:59:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 21:59:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:57 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 21:59:57 user nova-compute[71364]: INFO nova.compute.claims [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Claim successful on node user
Apr 11 21:59:57 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 21:59:57 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 21:59:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 21:59:58 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.policy [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c88df8be325448df9b24d49c3a7f6504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1f96aca4e547ef93d0d811ab4a8840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 21:59:58 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Creating image(s)
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "/opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "/opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "/opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/disk 1073741824" returned: 0 in 0.059s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.160s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Cannot resize image /opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.objects.instance [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lazy-loading 'migration_context' on Instance uuid 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Ensure instance console log exists: /opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Successfully created port: 99a12765-8c07-4345-9894-fc69ca59986f {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 21:59:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Updating instance_info_cache with network_info: [{"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Successfully updated port: 99a12765-8c07-4345-9894-fc69ca59986f {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "refresh_cache-1da9a03b-9918-4b39-9a15-6cb7e5a2a967" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquired lock "refresh_cache-1da9a03b-9918-4b39-9a15-6cb7e5a2a967" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-bac48d42-819a-44e6-8588-312ab1c9aef8 req-d9b18eb0-3079-43de-a734-53c388f544c9 service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Received event network-changed-99a12765-8c07-4345-9894-fc69ca59986f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-bac48d42-819a-44e6-8588-312ab1c9aef8 req-d9b18eb0-3079-43de-a734-53c388f544c9 service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Refreshing instance network info cache due to event network-changed-99a12765-8c07-4345-9894-fc69ca59986f. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bac48d42-819a-44e6-8588-312ab1c9aef8 req-d9b18eb0-3079-43de-a734-53c388f544c9 service nova] Acquiring lock "refresh_cache-1da9a03b-9918-4b39-9a15-6cb7e5a2a967" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 21:59:59 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Updating instance_info_cache with network_info: [{"id": "99a12765-8c07-4345-9894-fc69ca59986f", "address": "fa:16:3e:9c:f3:95", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a12765-8c", "ovs_interfaceid": "99a12765-8c07-4345-9894-fc69ca59986f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Releasing lock "refresh_cache-1da9a03b-9918-4b39-9a15-6cb7e5a2a967" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Instance network_info: |[{"id": "99a12765-8c07-4345-9894-fc69ca59986f", "address": "fa:16:3e:9c:f3:95", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a12765-8c", "ovs_interfaceid": "99a12765-8c07-4345-9894-fc69ca59986f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bac48d42-819a-44e6-8588-312ab1c9aef8 req-d9b18eb0-3079-43de-a734-53c388f544c9 service nova] Acquired lock "refresh_cache-1da9a03b-9918-4b39-9a15-6cb7e5a2a967" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.network.neutron [req-bac48d42-819a-44e6-8588-312ab1c9aef8 req-d9b18eb0-3079-43de-a734-53c388f544c9 service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Refreshing network info cache for port 99a12765-8c07-4345-9894-fc69ca59986f {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Start _get_guest_xml network_info=[{"id": "99a12765-8c07-4345-9894-fc69ca59986f", "address": "fa:16:3e:9c:f3:95", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a12765-8c", "ovs_interfaceid": "99a12765-8c07-4345-9894-fc69ca59986f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:00:00 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:00:00 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-609880783',display_name='tempest-VolumesActionsTest-instance-609880783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-609880783',id=25,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf1f96aca4e547ef93d0d811ab4a8840',ramdisk_id='',reservation_id='r-kdhdqhpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-214311813',owner_user_name='tempest-VolumesActionsTest-214311813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:59:58Z,user_data=None,user_id='c88df8be325448df9b24d49c3a7f6504',uuid=1da9a03b-9918-4b39-9a15-6cb7e5a2a967,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99a12765-8c07-4345-9894-fc69ca59986f", "address": "fa:16:3e:9c:f3:95", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a12765-8c", "ovs_interfaceid": "99a12765-8c07-4345-9894-fc69ca59986f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Converting VIF {"id": "99a12765-8c07-4345-9894-fc69ca59986f", "address": "fa:16:3e:9c:f3:95", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a12765-8c", "ovs_interfaceid": "99a12765-8c07-4345-9894-fc69ca59986f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=99a12765-8c07-4345-9894-fc69ca59986f,network=Network(0c9b930b-ce00-4ef1-9c4f-057d0212e71d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a12765-8c') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.objects.instance [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lazy-loading 'pci_devices' on Instance uuid 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:00:00 user nova-compute[71364]:   <uuid>1da9a03b-9918-4b39-9a15-6cb7e5a2a967</uuid>
Apr 11 22:00:00 user nova-compute[71364]:   <name>instance-00000019</name>
Apr 11 22:00:00 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:00:00 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:00:00 user nova-compute[71364]:   <metadata>
Apr 11 22:00:00 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:00:00 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:00:00 user nova-compute[71364]:       <nova:name>tempest-VolumesActionsTest-instance-609880783</nova:name>
Apr 11 22:00:00 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:00:00</nova:creationTime>
Apr 11 22:00:00 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:00:00 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:00:00 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:00:00 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:00:00 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:00:00 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:00:00 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:00:00 user nova-compute[71364]:       <nova:owner>
Apr 11 22:00:00 user nova-compute[71364]:         <nova:user uuid="c88df8be325448df9b24d49c3a7f6504">tempest-VolumesActionsTest-214311813-project-member</nova:user>
Apr 11 22:00:00 user nova-compute[71364]:         <nova:project uuid="bf1f96aca4e547ef93d0d811ab4a8840">tempest-VolumesActionsTest-214311813</nova:project>
Apr 11 22:00:00 user nova-compute[71364]:       </nova:owner>
Apr 11 22:00:00 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:00:00 user nova-compute[71364]:       <nova:ports>
Apr 11 22:00:00 user nova-compute[71364]:         <nova:port uuid="99a12765-8c07-4345-9894-fc69ca59986f">
Apr 11 22:00:00 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 11 22:00:00 user nova-compute[71364]:         </nova:port>
Apr 11 22:00:00 user nova-compute[71364]:       </nova:ports>
Apr 11 22:00:00 user nova-compute[71364]:     </nova:instance>
Apr 11 22:00:00 user nova-compute[71364]:   </metadata>
Apr 11 22:00:00 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:00:00 user nova-compute[71364]:     <system>
Apr 11 22:00:00 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:00:00 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:00:00 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:00:00 user nova-compute[71364]:       <entry name="serial">1da9a03b-9918-4b39-9a15-6cb7e5a2a967</entry>
Apr 11 22:00:00 user nova-compute[71364]:       <entry name="uuid">1da9a03b-9918-4b39-9a15-6cb7e5a2a967</entry>
Apr 11 22:00:00 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:00:00 user nova-compute[71364]:     </system>
Apr 11 22:00:00 user nova-compute[71364]:   </sysinfo>
Apr 11 22:00:00 user nova-compute[71364]:   <os>
Apr 11 22:00:00 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:00:00 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:00:00 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:00:00 user nova-compute[71364]:   </os>
Apr 11 22:00:00 user nova-compute[71364]:   <features>
Apr 11 22:00:00 user nova-compute[71364]:     <acpi/>
Apr 11 22:00:00 user nova-compute[71364]:     <apic/>
Apr 11 22:00:00 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:00:00 user nova-compute[71364]:   </features>
Apr 11 22:00:00 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:00:00 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:00:00 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:00:00 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:00:00 user nova-compute[71364]:   </clock>
Apr 11 22:00:00 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:00:00 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:00:00 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:00:00 user nova-compute[71364]:   </cpu>
Apr 11 22:00:00 user nova-compute[71364]:   <devices>
Apr 11 22:00:00 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:00:00 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:00:00 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/disk"/>
Apr 11 22:00:00 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:00:00 user nova-compute[71364]:     </disk>
Apr 11 22:00:00 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:00:00 user nova-compute[71364]:       <mac address="fa:16:3e:9c:f3:95"/>
Apr 11 22:00:00 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:00:00 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:00:00 user nova-compute[71364]:       <target dev="tap99a12765-8c"/>
Apr 11 22:00:00 user nova-compute[71364]:     </interface>
Apr 11 22:00:00 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:00:00 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/console.log" append="off"/>
Apr 11 22:00:00 user nova-compute[71364]:     </serial>
Apr 11 22:00:00 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:00:00 user nova-compute[71364]:     <video>
Apr 11 22:00:00 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:00:00 user nova-compute[71364]:     </video>
Apr 11 22:00:00 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:00:00 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:00:00 user nova-compute[71364]:     </rng>
Apr 11 22:00:00 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:00:00 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:00:00 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:00:00 user nova-compute[71364]:     </memballoon>
Apr 11 22:00:00 user nova-compute[71364]:   </devices>
Apr 11 22:00:00 user nova-compute[71364]: </domain>
Apr 11 22:00:00 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-609880783',display_name='tempest-VolumesActionsTest-instance-609880783',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-609880783',id=25,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf1f96aca4e547ef93d0d811ab4a8840',ramdisk_id='',reservation_id='r-kdhdqhpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-214311813',owner_user_name='tempest-VolumesActionsTest-214311813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:59:58Z,user_data=None,user_id='c88df8be325448df9b24d49c3a7f6504',uuid=1da9a03b-9918-4b39-9a15-6cb7e5a2a967,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99a12765-8c07-4345-9894-fc69ca59986f", "address": "fa:16:3e:9c:f3:95", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a12765-8c", "ovs_interfaceid": "99a12765-8c07-4345-9894-fc69ca59986f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Converting VIF {"id": "99a12765-8c07-4345-9894-fc69ca59986f", "address": "fa:16:3e:9c:f3:95", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a12765-8c", "ovs_interfaceid": "99a12765-8c07-4345-9894-fc69ca59986f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=99a12765-8c07-4345-9894-fc69ca59986f,network=Network(0c9b930b-ce00-4ef1-9c4f-057d0212e71d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a12765-8c') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG os_vif [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=99a12765-8c07-4345-9894-fc69ca59986f,network=Network(0c9b930b-ce00-4ef1-9c4f-057d0212e71d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a12765-8c') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99a12765-8c, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99a12765-8c, col_values=(('external_ids', {'iface-id': '99a12765-8c07-4345-9894-fc69ca59986f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:f3:95', 'vm-uuid': '1da9a03b-9918-4b39-9a15-6cb7e5a2a967'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:00 user nova-compute[71364]: INFO os_vif [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=99a12765-8c07-4345-9894-fc69ca59986f,network=Network(0c9b930b-ce00-4ef1-9c4f-057d0212e71d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a12765-8c')
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] No VIF found with MAC fa:16:3e:9c:f3:95, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.network.neutron [req-bac48d42-819a-44e6-8588-312ab1c9aef8 req-d9b18eb0-3079-43de-a734-53c388f544c9 service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Updated VIF entry in instance network info cache for port 99a12765-8c07-4345-9894-fc69ca59986f. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG nova.network.neutron [req-bac48d42-819a-44e6-8588-312ab1c9aef8 req-d9b18eb0-3079-43de-a734-53c388f544c9 service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Updating instance_info_cache with network_info: [{"id": "99a12765-8c07-4345-9894-fc69ca59986f", "address": "fa:16:3e:9c:f3:95", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a12765-8c", "ovs_interfaceid": "99a12765-8c07-4345-9894-fc69ca59986f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:00:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bac48d42-819a-44e6-8588-312ab1c9aef8 req-d9b18eb0-3079-43de-a734-53c388f544c9 service nova] Releasing lock "refresh_cache-1da9a03b-9918-4b39-9a15-6cb7e5a2a967" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:00:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:02 user nova-compute[71364]: DEBUG nova.compute.manager [req-991c5e7a-5e87-4c97-acee-707d883d35b8 req-1dd67852-382d-4cb2-9328-bb56a3f4d307 service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Received event network-vif-plugged-99a12765-8c07-4345-9894-fc69ca59986f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-991c5e7a-5e87-4c97-acee-707d883d35b8 req-1dd67852-382d-4cb2-9328-bb56a3f4d307 service nova] Acquiring lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-991c5e7a-5e87-4c97-acee-707d883d35b8 req-1dd67852-382d-4cb2-9328-bb56a3f4d307 service nova] Lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-991c5e7a-5e87-4c97-acee-707d883d35b8 req-1dd67852-382d-4cb2-9328-bb56a3f4d307 service nova] Lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:02 user nova-compute[71364]: DEBUG nova.compute.manager [req-991c5e7a-5e87-4c97-acee-707d883d35b8 req-1dd67852-382d-4cb2-9328-bb56a3f4d307 service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] No waiting events found dispatching network-vif-plugged-99a12765-8c07-4345-9894-fc69ca59986f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:00:02 user nova-compute[71364]: WARNING nova.compute.manager [req-991c5e7a-5e87-4c97-acee-707d883d35b8 req-1dd67852-382d-4cb2-9328-bb56a3f4d307 service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Received unexpected event network-vif-plugged-99a12765-8c07-4345-9894-fc69ca59986f for instance with vm_state building and task_state spawning.
Apr 11 22:00:03 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250403.9540908, 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:00:03 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] VM Resumed (Lifecycle Event)
Apr 11 22:00:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:00:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:00:03 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Instance spawned successfully.
Apr 11 22:00:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:00:04 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:00:04 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250403.9591513, 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:00:04 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] VM Started (Lifecycle Event)
Apr 11 22:00:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:00:04 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:00:04 user nova-compute[71364]: INFO nova.compute.manager [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Took 5.91 seconds to spawn the instance on the hypervisor.
Apr 11 22:00:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG nova.compute.manager [req-ea55d5bd-cde1-4760-8b87-8247c517e24d req-426ba6cd-33cc-45d8-88fd-8152f27120f4 service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Received event network-vif-plugged-99a12765-8c07-4345-9894-fc69ca59986f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ea55d5bd-cde1-4760-8b87-8247c517e24d req-426ba6cd-33cc-45d8-88fd-8152f27120f4 service nova] Acquiring lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ea55d5bd-cde1-4760-8b87-8247c517e24d req-426ba6cd-33cc-45d8-88fd-8152f27120f4 service nova] Lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ea55d5bd-cde1-4760-8b87-8247c517e24d req-426ba6cd-33cc-45d8-88fd-8152f27120f4 service nova] Lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:04 user nova-compute[71364]: DEBUG nova.compute.manager [req-ea55d5bd-cde1-4760-8b87-8247c517e24d req-426ba6cd-33cc-45d8-88fd-8152f27120f4 service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] No waiting events found dispatching network-vif-plugged-99a12765-8c07-4345-9894-fc69ca59986f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:00:04 user nova-compute[71364]: WARNING nova.compute.manager [req-ea55d5bd-cde1-4760-8b87-8247c517e24d req-426ba6cd-33cc-45d8-88fd-8152f27120f4 service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Received unexpected event network-vif-plugged-99a12765-8c07-4345-9894-fc69ca59986f for instance with vm_state building and task_state spawning.
Apr 11 22:00:04 user nova-compute[71364]: INFO nova.compute.manager [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Took 6.69 seconds to build instance.
Apr 11 22:00:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.785s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-52571afd-3938-4e3f-a42b-86ec63909a31 req-95ee4b6a-fb90-42f1-82be-5d459180ce74 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Received event network-changed-85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-52571afd-3938-4e3f-a42b-86ec63909a31 req-95ee4b6a-fb90-42f1-82be-5d459180ce74 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Refreshing instance network info cache due to event network-changed-85f4272f-45d2-4396-aba0-66a632eb9a74. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-52571afd-3938-4e3f-a42b-86ec63909a31 req-95ee4b6a-fb90-42f1-82be-5d459180ce74 service nova] Acquiring lock "refresh_cache-56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-52571afd-3938-4e3f-a42b-86ec63909a31 req-95ee4b6a-fb90-42f1-82be-5d459180ce74 service nova] Acquired lock "refresh_cache-56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG nova.network.neutron [req-52571afd-3938-4e3f-a42b-86ec63909a31 req-95ee4b6a-fb90-42f1-82be-5d459180ce74 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Refreshing network info cache for port 85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:29 user nova-compute[71364]: INFO nova.compute.manager [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Terminating instance
Apr 11 22:00:29 user nova-compute[71364]: DEBUG nova.compute.manager [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-7a8248b3-d74b-432a-bb26-ab6d2d632406 req-29b95130-c991-4634-97b4-831ef226e545 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Received event network-vif-unplugged-85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7a8248b3-d74b-432a-bb26-ab6d2d632406 req-29b95130-c991-4634-97b4-831ef226e545 service nova] Acquiring lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7a8248b3-d74b-432a-bb26-ab6d2d632406 req-29b95130-c991-4634-97b4-831ef226e545 service nova] Lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7a8248b3-d74b-432a-bb26-ab6d2d632406 req-29b95130-c991-4634-97b4-831ef226e545 service nova] Lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-7a8248b3-d74b-432a-bb26-ab6d2d632406 req-29b95130-c991-4634-97b4-831ef226e545 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] No waiting events found dispatching network-vif-unplugged-85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:00:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-7a8248b3-d74b-432a-bb26-ab6d2d632406 req-29b95130-c991-4634-97b4-831ef226e545 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Received event network-vif-unplugged-85f4272f-45d2-4396-aba0-66a632eb9a74 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:00:30 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Instance destroyed successfully.
Apr 11 22:00:30 user nova-compute[71364]: DEBUG nova.objects.instance [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'resources' on Instance uuid 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:00:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:58:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2021918265',display_name='tempest-AttachVolumeNegativeTest-server-2021918265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2021918265',id=24,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5HXG4uNR4Lx0Ce/mlySrXNCX9hSl8GiFiHSNVDVef2acfJ/hC+pL91fSMxh4hMX/W1wSrf0WbvHk2Mk/eCWX6XJDnNd3lt6v/7+U4PJZ+5Q3lWD02xoO6oZPKC9tDGBg==',key_name='tempest-keypair-1376241253',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:58:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='722a2704f607415ebe42af5ad98bf419',ramdisk_id='',reservation_id='r-ranp7lte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2131251711',owner_user_name='tempest-AttachVolumeNegativeTest-2131251711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:58:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d615e85afb4354b37e88b5a24429d8',uuid=56a64679-9fe1-4b14-9b71-c3a9a7ab0e91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85f4272f-45d2-4396-aba0-66a632eb9a74", "address": "fa:16:3e:38:fa:99", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f4272f-45", "ovs_interfaceid": "85f4272f-45d2-4396-aba0-66a632eb9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:00:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converting VIF {"id": "85f4272f-45d2-4396-aba0-66a632eb9a74", "address": "fa:16:3e:38:fa:99", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f4272f-45", "ovs_interfaceid": "85f4272f-45d2-4396-aba0-66a632eb9a74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:00:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:fa:99,bridge_name='br-int',has_traffic_filtering=True,id=85f4272f-45d2-4396-aba0-66a632eb9a74,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f4272f-45') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:00:30 user nova-compute[71364]: DEBUG os_vif [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:fa:99,bridge_name='br-int',has_traffic_filtering=True,id=85f4272f-45d2-4396-aba0-66a632eb9a74,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f4272f-45') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:00:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85f4272f-45, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:00:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:00:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:30 user nova-compute[71364]: INFO os_vif [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:fa:99,bridge_name='br-int',has_traffic_filtering=True,id=85f4272f-45d2-4396-aba0-66a632eb9a74,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85f4272f-45')
Apr 11 22:00:30 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Deleting instance files /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91_del
Apr 11 22:00:30 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Deletion of /opt/stack/data/nova/instances/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91_del complete
Apr 11 22:00:30 user nova-compute[71364]: DEBUG nova.network.neutron [req-52571afd-3938-4e3f-a42b-86ec63909a31 req-95ee4b6a-fb90-42f1-82be-5d459180ce74 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Updated VIF entry in instance network info cache for port 85f4272f-45d2-4396-aba0-66a632eb9a74. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:00:30 user nova-compute[71364]: DEBUG nova.network.neutron [req-52571afd-3938-4e3f-a42b-86ec63909a31 req-95ee4b6a-fb90-42f1-82be-5d459180ce74 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Updating instance_info_cache with network_info: [{"id": "85f4272f-45d2-4396-aba0-66a632eb9a74", "address": "fa:16:3e:38:fa:99", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85f4272f-45", "ovs_interfaceid": "85f4272f-45d2-4396-aba0-66a632eb9a74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:00:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-52571afd-3938-4e3f-a42b-86ec63909a31 req-95ee4b6a-fb90-42f1-82be-5d459180ce74 service nova] Releasing lock "refresh_cache-56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:00:30 user nova-compute[71364]: INFO nova.compute.manager [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 11 22:00:30 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:00:30 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:00:30 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:00:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:31 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:00:31 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Took 1.62 seconds to deallocate network for instance.
Apr 11 22:00:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-583accd7-2017-4511-b424-f29a5314e7da req-bb9ce478-3964-4878-a3bb-a879ae072987 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Received event network-vif-deleted-85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:31 user nova-compute[71364]: INFO nova.compute.manager [req-583accd7-2017-4511-b424-f29a5314e7da req-bb9ce478-3964-4878-a3bb-a879ae072987 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Neutron deleted interface 85f4272f-45d2-4396-aba0-66a632eb9a74; detaching it from the instance and deleting it from the info cache
Apr 11 22:00:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-583accd7-2017-4511-b424-f29a5314e7da req-bb9ce478-3964-4878-a3bb-a879ae072987 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:00:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-583accd7-2017-4511-b424-f29a5314e7da req-bb9ce478-3964-4878-a3bb-a879ae072987 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Detach interface failed, port_id=85f4272f-45d2-4396-aba0-66a632eb9a74, reason: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 22:00:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-38600bf2-1e8b-4102-a706-b56d95e11f3b req-3d18dcb2-1865-4269-9d70-a71c00884420 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Received event network-vif-plugged-85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-38600bf2-1e8b-4102-a706-b56d95e11f3b req-3d18dcb2-1865-4269-9d70-a71c00884420 service nova] Acquiring lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-38600bf2-1e8b-4102-a706-b56d95e11f3b req-3d18dcb2-1865-4269-9d70-a71c00884420 service nova] Lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-38600bf2-1e8b-4102-a706-b56d95e11f3b req-3d18dcb2-1865-4269-9d70-a71c00884420 service nova] Lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-38600bf2-1e8b-4102-a706-b56d95e11f3b req-3d18dcb2-1865-4269-9d70-a71c00884420 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] No waiting events found dispatching network-vif-plugged-85f4272f-45d2-4396-aba0-66a632eb9a74 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:00:32 user nova-compute[71364]: WARNING nova.compute.manager [req-38600bf2-1e8b-4102-a706-b56d95e11f3b req-3d18dcb2-1865-4269-9d70-a71c00884420 service nova] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Received unexpected event network-vif-plugged-85f4272f-45d2-4396-aba0-66a632eb9a74 for instance with vm_state deleted and task_state None.
Apr 11 22:00:32 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:00:32 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:00:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:32 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Deleted allocations for instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91
Apr 11 22:00:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.873s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:35 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:00:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:35 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:00:35 user nova-compute[71364]: INFO nova.compute.claims [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Claim successful on node user
Apr 11 22:00:36 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:00:36 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:00:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG nova.policy [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8bf56678e2a43108a7732fb0b2ea44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e47eb6cfb467a943499e4b6172d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:00:36 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Creating image(s)
Apr 11 22:00:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "/opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "/opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "/opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk 1073741824" returned: 0 in 0.048s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:37 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:00:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:37 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Cannot resize image /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:00:37 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'migration_context' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:00:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:00:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Ensure instance console log exists: /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:00:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:37 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Successfully created port: 660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Successfully updated port: 660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "refresh_cache-5366a438-0f96-4ae2-8c99-48f98501baa3" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquired lock "refresh_cache-5366a438-0f96-4ae2-8c99-48f98501baa3" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.compute.manager [req-d23028d4-9302-461a-9bb4-bf7d68c33ce0 req-f3ae6711-6bc8-4364-b60d-2969a143c8f7 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Received event network-changed-660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.compute.manager [req-d23028d4-9302-461a-9bb4-bf7d68c33ce0 req-f3ae6711-6bc8-4364-b60d-2969a143c8f7 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Refreshing instance network info cache due to event network-changed-660ded54-a2aa-4862-91a0-1aa1948cb5a0. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d23028d4-9302-461a-9bb4-bf7d68c33ce0 req-f3ae6711-6bc8-4364-b60d-2969a143c8f7 service nova] Acquiring lock "refresh_cache-5366a438-0f96-4ae2-8c99-48f98501baa3" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Updating instance_info_cache with network_info: [{"id": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "address": "fa:16:3e:49:5f:74", "network": {"id": "b465435f-c5f6-4407-a24c-2a48de8b4b28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28080865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99e47eb6cfb467a943499e4b6172d5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660ded54-a2", "ovs_interfaceid": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Releasing lock "refresh_cache-5366a438-0f96-4ae2-8c99-48f98501baa3" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Instance network_info: |[{"id": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "address": "fa:16:3e:49:5f:74", "network": {"id": "b465435f-c5f6-4407-a24c-2a48de8b4b28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28080865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99e47eb6cfb467a943499e4b6172d5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660ded54-a2", "ovs_interfaceid": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d23028d4-9302-461a-9bb4-bf7d68c33ce0 req-f3ae6711-6bc8-4364-b60d-2969a143c8f7 service nova] Acquired lock "refresh_cache-5366a438-0f96-4ae2-8c99-48f98501baa3" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.network.neutron [req-d23028d4-9302-461a-9bb4-bf7d68c33ce0 req-f3ae6711-6bc8-4364-b60d-2969a143c8f7 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Refreshing network info cache for port 660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Start _get_guest_xml network_info=[{"id": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "address": "fa:16:3e:49:5f:74", "network": {"id": "b465435f-c5f6-4407-a24c-2a48de8b4b28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28080865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99e47eb6cfb467a943499e4b6172d5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660ded54-a2", "ovs_interfaceid": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:00:38 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:00:38 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1212824966',display_name='tempest-SnapshotDataIntegrityTests-server-1212824966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1212824966',id=26,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBzUl8HvDUTg7Id3OSxTvkzP49WOAu3H283oGSTgo0KG3nA0bN4Q4nshmcPLueExTWYD/2zosDdYSCOikl8MUtstEkFgvYKkQYR8M0ySMROhbHmo+3F6wBPo0mNlx825g==',key_name='tempest-SnapshotDataIntegrityTests-1090433161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b99e47eb6cfb467a943499e4b6172d5d',ramdisk_id='',reservation_id='r-qq7u7682',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-328709204',owner_user_name='tempest-SnapshotDataIntegrityTests-328709204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:00:37Z,user_data=None,user_id='c8bf56678e2a43108a7732fb0b2ea44c',uuid=5366a438-0f96-4ae2-8c99-48f98501baa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "address": "fa:16:3e:49:5f:74", "network": {"id": "b465435f-c5f6-4407-a24c-2a48de8b4b28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28080865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99e47eb6cfb467a943499e4b6172d5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660ded54-a2", "ovs_interfaceid": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Converting VIF {"id": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "address": "fa:16:3e:49:5f:74", "network": {"id": "b465435f-c5f6-4407-a24c-2a48de8b4b28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28080865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99e47eb6cfb467a943499e4b6172d5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660ded54-a2", "ovs_interfaceid": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:5f:74,bridge_name='br-int',has_traffic_filtering=True,id=660ded54-a2aa-4862-91a0-1aa1948cb5a0,network=Network(b465435f-c5f6-4407-a24c-2a48de8b4b28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660ded54-a2') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'pci_devices' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:00:38 user nova-compute[71364]:   <uuid>5366a438-0f96-4ae2-8c99-48f98501baa3</uuid>
Apr 11 22:00:38 user nova-compute[71364]:   <name>instance-0000001a</name>
Apr 11 22:00:38 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:00:38 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:00:38 user nova-compute[71364]:   <metadata>
Apr 11 22:00:38 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:00:38 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:00:38 user nova-compute[71364]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1212824966</nova:name>
Apr 11 22:00:38 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:00:38</nova:creationTime>
Apr 11 22:00:38 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:00:38 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:00:38 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:00:38 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:00:38 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:00:38 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:00:38 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:00:38 user nova-compute[71364]:       <nova:owner>
Apr 11 22:00:38 user nova-compute[71364]:         <nova:user uuid="c8bf56678e2a43108a7732fb0b2ea44c">tempest-SnapshotDataIntegrityTests-328709204-project-member</nova:user>
Apr 11 22:00:38 user nova-compute[71364]:         <nova:project uuid="b99e47eb6cfb467a943499e4b6172d5d">tempest-SnapshotDataIntegrityTests-328709204</nova:project>
Apr 11 22:00:38 user nova-compute[71364]:       </nova:owner>
Apr 11 22:00:38 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:00:38 user nova-compute[71364]:       <nova:ports>
Apr 11 22:00:38 user nova-compute[71364]:         <nova:port uuid="660ded54-a2aa-4862-91a0-1aa1948cb5a0">
Apr 11 22:00:38 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 22:00:38 user nova-compute[71364]:         </nova:port>
Apr 11 22:00:38 user nova-compute[71364]:       </nova:ports>
Apr 11 22:00:38 user nova-compute[71364]:     </nova:instance>
Apr 11 22:00:38 user nova-compute[71364]:   </metadata>
Apr 11 22:00:38 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:00:38 user nova-compute[71364]:     <system>
Apr 11 22:00:38 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:00:38 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:00:38 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:00:38 user nova-compute[71364]:       <entry name="serial">5366a438-0f96-4ae2-8c99-48f98501baa3</entry>
Apr 11 22:00:38 user nova-compute[71364]:       <entry name="uuid">5366a438-0f96-4ae2-8c99-48f98501baa3</entry>
Apr 11 22:00:38 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:00:38 user nova-compute[71364]:     </system>
Apr 11 22:00:38 user nova-compute[71364]:   </sysinfo>
Apr 11 22:00:38 user nova-compute[71364]:   <os>
Apr 11 22:00:38 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:00:38 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:00:38 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:00:38 user nova-compute[71364]:   </os>
Apr 11 22:00:38 user nova-compute[71364]:   <features>
Apr 11 22:00:38 user nova-compute[71364]:     <acpi/>
Apr 11 22:00:38 user nova-compute[71364]:     <apic/>
Apr 11 22:00:38 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:00:38 user nova-compute[71364]:   </features>
Apr 11 22:00:38 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:00:38 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:00:38 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:00:38 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:00:38 user nova-compute[71364]:   </clock>
Apr 11 22:00:38 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:00:38 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:00:38 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:00:38 user nova-compute[71364]:   </cpu>
Apr 11 22:00:38 user nova-compute[71364]:   <devices>
Apr 11 22:00:38 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:00:38 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:00:38 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk"/>
Apr 11 22:00:38 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:00:38 user nova-compute[71364]:     </disk>
Apr 11 22:00:38 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:00:38 user nova-compute[71364]:       <mac address="fa:16:3e:49:5f:74"/>
Apr 11 22:00:38 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:00:38 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:00:38 user nova-compute[71364]:       <target dev="tap660ded54-a2"/>
Apr 11 22:00:38 user nova-compute[71364]:     </interface>
Apr 11 22:00:38 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:00:38 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/console.log" append="off"/>
Apr 11 22:00:38 user nova-compute[71364]:     </serial>
Apr 11 22:00:38 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:00:38 user nova-compute[71364]:     <video>
Apr 11 22:00:38 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:00:38 user nova-compute[71364]:     </video>
Apr 11 22:00:38 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:00:38 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:00:38 user nova-compute[71364]:     </rng>
Apr 11 22:00:38 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:00:38 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:00:38 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:00:38 user nova-compute[71364]:     </memballoon>
Apr 11 22:00:38 user nova-compute[71364]:   </devices>
Apr 11 22:00:38 user nova-compute[71364]: </domain>
Apr 11 22:00:38 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1212824966',display_name='tempest-SnapshotDataIntegrityTests-server-1212824966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1212824966',id=26,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBzUl8HvDUTg7Id3OSxTvkzP49WOAu3H283oGSTgo0KG3nA0bN4Q4nshmcPLueExTWYD/2zosDdYSCOikl8MUtstEkFgvYKkQYR8M0ySMROhbHmo+3F6wBPo0mNlx825g==',key_name='tempest-SnapshotDataIntegrityTests-1090433161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b99e47eb6cfb467a943499e4b6172d5d',ramdisk_id='',reservation_id='r-qq7u7682',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-328709204',owner_user_name='tempest-SnapshotDataIntegrityTests-328709204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:00:37Z,user_data=None,user_id='c8bf56678e2a43108a7732fb0b2ea44c',uuid=5366a438-0f96-4ae2-8c99-48f98501baa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "address": "fa:16:3e:49:5f:74", "network": {"id": "b465435f-c5f6-4407-a24c-2a48de8b4b28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28080865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99e47eb6cfb467a943499e4b6172d5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660ded54-a2", "ovs_interfaceid": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Converting VIF {"id": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "address": "fa:16:3e:49:5f:74", "network": {"id": "b465435f-c5f6-4407-a24c-2a48de8b4b28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28080865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99e47eb6cfb467a943499e4b6172d5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660ded54-a2", "ovs_interfaceid": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:5f:74,bridge_name='br-int',has_traffic_filtering=True,id=660ded54-a2aa-4862-91a0-1aa1948cb5a0,network=Network(b465435f-c5f6-4407-a24c-2a48de8b4b28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660ded54-a2') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG os_vif [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:5f:74,bridge_name='br-int',has_traffic_filtering=True,id=660ded54-a2aa-4862-91a0-1aa1948cb5a0,network=Network(b465435f-c5f6-4407-a24c-2a48de8b4b28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660ded54-a2') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap660ded54-a2, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap660ded54-a2, col_values=(('external_ids', {'iface-id': '660ded54-a2aa-4862-91a0-1aa1948cb5a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:5f:74', 'vm-uuid': '5366a438-0f96-4ae2-8c99-48f98501baa3'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:38 user nova-compute[71364]: INFO os_vif [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:5f:74,bridge_name='br-int',has_traffic_filtering=True,id=660ded54-a2aa-4862-91a0-1aa1948cb5a0,network=Network(b465435f-c5f6-4407-a24c-2a48de8b4b28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660ded54-a2')
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] No VIF found with MAC fa:16:3e:49:5f:74, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.network.neutron [req-d23028d4-9302-461a-9bb4-bf7d68c33ce0 req-f3ae6711-6bc8-4364-b60d-2969a143c8f7 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Updated VIF entry in instance network info cache for port 660ded54-a2aa-4862-91a0-1aa1948cb5a0. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG nova.network.neutron [req-d23028d4-9302-461a-9bb4-bf7d68c33ce0 req-f3ae6711-6bc8-4364-b60d-2969a143c8f7 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Updating instance_info_cache with network_info: [{"id": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "address": "fa:16:3e:49:5f:74", "network": {"id": "b465435f-c5f6-4407-a24c-2a48de8b4b28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28080865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99e47eb6cfb467a943499e4b6172d5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660ded54-a2", "ovs_interfaceid": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:00:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d23028d4-9302-461a-9bb4-bf7d68c33ce0 req-f3ae6711-6bc8-4364-b60d-2969a143c8f7 service nova] Releasing lock "refresh_cache-5366a438-0f96-4ae2-8c99-48f98501baa3" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:00:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:40 user nova-compute[71364]: DEBUG nova.compute.manager [req-9906a399-9113-4216-b8a1-a62c34f73ffc req-28d3f2f7-b33c-4b98-9220-ba8b9dfebd10 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Received event network-vif-plugged-660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9906a399-9113-4216-b8a1-a62c34f73ffc req-28d3f2f7-b33c-4b98-9220-ba8b9dfebd10 service nova] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9906a399-9113-4216-b8a1-a62c34f73ffc req-28d3f2f7-b33c-4b98-9220-ba8b9dfebd10 service nova] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9906a399-9113-4216-b8a1-a62c34f73ffc req-28d3f2f7-b33c-4b98-9220-ba8b9dfebd10 service nova] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:40 user nova-compute[71364]: DEBUG nova.compute.manager [req-9906a399-9113-4216-b8a1-a62c34f73ffc req-28d3f2f7-b33c-4b98-9220-ba8b9dfebd10 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] No waiting events found dispatching network-vif-plugged-660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:00:40 user nova-compute[71364]: WARNING nova.compute.manager [req-9906a399-9113-4216-b8a1-a62c34f73ffc req-28d3f2f7-b33c-4b98-9220-ba8b9dfebd10 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Received unexpected event network-vif-plugged-660ded54-a2aa-4862-91a0-1aa1948cb5a0 for instance with vm_state building and task_state spawning.
Apr 11 22:00:40 user nova-compute[71364]: DEBUG nova.network.neutron [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Port 6144f13d-b463-46ef-b75b-d2d982198b72 binding to destination host user is already ACTIVE {{(pid=71364) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 22:00:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:00:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquired lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:00:40 user nova-compute[71364]: DEBUG nova.network.neutron [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:00:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:41 user nova-compute[71364]: DEBUG nova.network.neutron [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating instance_info_cache with network_info: [{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:00:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Releasing lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:00:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Creating tmpfile /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/tmpby9nk2h_ to verify with other compute node that the instance is on the same shared storage. {{(pid=71364) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 11 22:00:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-50c51bae-0e47-433d-a7ef-c5b8be56727d req-0ff88c0a-14cc-4389-9113-e4f2475f37e2 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-unplugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-50c51bae-0e47-433d-a7ef-c5b8be56727d req-0ff88c0a-14cc-4389-9113-e4f2475f37e2 service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-50c51bae-0e47-433d-a7ef-c5b8be56727d req-0ff88c0a-14cc-4389-9113-e4f2475f37e2 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-50c51bae-0e47-433d-a7ef-c5b8be56727d req-0ff88c0a-14cc-4389-9113-e4f2475f37e2 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-50c51bae-0e47-433d-a7ef-c5b8be56727d req-0ff88c0a-14cc-4389-9113-e4f2475f37e2 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-unplugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:00:41 user nova-compute[71364]: WARNING nova.compute.manager [req-50c51bae-0e47-433d-a7ef-c5b8be56727d req-0ff88c0a-14cc-4389-9113-e4f2475f37e2 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-unplugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state resized and task_state resize_reverting.
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250442.1120782, 5366a438-0f96-4ae2-8c99-48f98501baa3 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:00:42 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] VM Resumed (Lifecycle Event)
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:00:42 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Instance spawned successfully.
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:00:42 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance destroyed successfully.
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.objects.instance [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'resources' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842337295',display_name='tempest-ServerActionsTestJSON-server-349398715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842337295',id=4,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-c34k408a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:59:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=5ff9bbaf-1a5e-4acd-aca3-d956728312cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_vif [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6144f13d-b4, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:42 user nova-compute[71364]: INFO os_vif [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4')
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dImUioOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:00:42 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:00:42 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250442.117433, 5366a438-0f96-4ae2-8c99-48f98501baa3 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:00:42 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] VM Started (Lifecycle Event)
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-6c77ff24-355d-4d57-84f9-6be1c4e83a79 req-647a6c00-ea8c-4744-bb7d-431212fccfab service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Received event network-vif-plugged-660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6c77ff24-355d-4d57-84f9-6be1c4e83a79 req-647a6c00-ea8c-4744-bb7d-431212fccfab service nova] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6c77ff24-355d-4d57-84f9-6be1c4e83a79 req-647a6c00-ea8c-4744-bb7d-431212fccfab service nova] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6c77ff24-355d-4d57-84f9-6be1c4e83a79 req-647a6c00-ea8c-4744-bb7d-431212fccfab service nova] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-6c77ff24-355d-4d57-84f9-6be1c4e83a79 req-647a6c00-ea8c-4744-bb7d-431212fccfab service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] No waiting events found dispatching network-vif-plugged-660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:00:42 user nova-compute[71364]: WARNING nova.compute.manager [req-6c77ff24-355d-4d57-84f9-6be1c4e83a79 req-647a6c00-ea8c-4744-bb7d-431212fccfab service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Received unexpected event network-vif-plugged-660ded54-a2aa-4862-91a0-1aa1948cb5a0 for instance with vm_state building and task_state spawning.
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4adfba-bb08-4afc-8215-59c8ffaf4b07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:00:42 user nova-compute[71364]: No targets found.
Apr 11 22:00:42 user nova-compute[71364]: iSNS:
Apr 11 22:00:42 user nova-compute[71364]: No targets found.
Apr 11 22:00:42 user nova-compute[71364]: STATIC:
Apr 11 22:00:42 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:00:42 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:00:42 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:00:42 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab
Apr 11 22:00:42 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:00:42 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:00:42 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870
Apr 11 22:00:42 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:00:42 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:00:42 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44
Apr 11 22:00:42 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:00:42 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:00:42 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe
Apr 11 22:00:42 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:00:42 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:00:42 user nova-compute[71364]: FIRMWARE:
Apr 11 22:00:42 user nova-compute[71364]: No targets found.
Apr 11 22:00:42 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:00:42 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:00:42 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:42 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:00:42 user nova-compute[71364]: INFO nova.compute.manager [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Took 5.64 seconds to spawn the instance on the hypervisor.
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e807a-106e-4e0d-88a8-b241e7897448]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[57466400-fe9e-4e0a-8c6a-76eaa3543849]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:00:42 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 22:00:42 user nova-compute[71364]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:00:42 user nova-compute[71364]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:00:42 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:00:42 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:00:42 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 22:00:42 user nova-compute[71364]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:00:42 user nova-compute[71364]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:00:42 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:00:42 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacf93250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab'): ({'sdd'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Removing single pathed devices sdd {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccc98ba-d29d-499e-b88d-00dfb0032596]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92430d0-589c-48a1-9fe6-ee00174fa7a2]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flushing IO for device /dev/sdd {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:42 user nova-compute[71364]: INFO nova.compute.manager [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Took 6.42 seconds to build instance.
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bdbcdc-88c7-4796-a072-ab17e1699d3c]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.518s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.067s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a9ce5f-262d-4ad3-8c79-36e37acabb14]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b63a593-78f6-406e-86d3-d16adcac1b3e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a6bd7a-9e38-4745-b357-c3e5ab5aed77]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260]
Apr 11 22:00:42 user nova-compute[71364]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260] successful.
Apr 11 22:00:42 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3daf29c-ba45-4f45-9f8a-0727f5c82900]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== disconnect_volume: return (381ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:00:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:00:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:43 user nova-compute[71364]: DEBUG nova.objects.instance [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'migration_context' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:00:43 user nova-compute[71364]: DEBUG nova.compute.manager [req-c83d8b41-56f9-4fb9-896c-c0aa29edfa0e req-7e8245cb-67e3-4147-8d19-636d5561a922 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c83d8b41-56f9-4fb9-896c-c0aa29edfa0e req-7e8245cb-67e3-4147-8d19-636d5561a922 service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c83d8b41-56f9-4fb9-896c-c0aa29edfa0e req-7e8245cb-67e3-4147-8d19-636d5561a922 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c83d8b41-56f9-4fb9-896c-c0aa29edfa0e req-7e8245cb-67e3-4147-8d19-636d5561a922 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:43 user nova-compute[71364]: DEBUG nova.compute.manager [req-c83d8b41-56f9-4fb9-896c-c0aa29edfa0e req-7e8245cb-67e3-4147-8d19-636d5561a922 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:00:43 user nova-compute[71364]: WARNING nova.compute.manager [req-c83d8b41-56f9-4fb9-896c-c0aa29edfa0e req-7e8245cb-67e3-4147-8d19-636d5561a922 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state resized and task_state resize_reverting.
Apr 11 22:00:43 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:00:43 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:00:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.474s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:44 user nova-compute[71364]: INFO nova.compute.manager [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Swapping old allocation on dict_keys(['c1fc3d49-a748-458e-8eba-ee7803982ec7']) held by migration 01a865c7-bab2-4298-9a39-2b17a34890c5 for instance
Apr 11 22:00:44 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Overwriting current allocation {'allocations': {'c1fc3d49-a748-458e-8eba-ee7803982ec7': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 31}}, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'user_id': '939785ef89cb491aae3df4f411b2543d', 'consumer_generation': 1} on consumer 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquired lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG nova.network.neutron [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG nova.network.neutron [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating instance_info_cache with network_info: [{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Releasing lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG os_brick.utils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9153e7f4-3c92-4824-8cf6-c779520ddbd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ed3fcd-1561-44ca-936f-e836b6e13840]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57599c9-f2a7-45cc-8ac0-3a23fc10f631]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5bc1b2-5ff3-4450-a50e-c812554a528b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:00:44 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:00:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84c2ace-9acf-4806-983b-7613d5c39c9e]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:00:44 user nova-compute[71364]: DEBUG os_brick.utils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:00:45 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250430.0781438, 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:00:45 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] VM Stopped (Lifecycle Event)
Apr 11 22:00:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-5669428c-5c23-43bb-b059-2b2e97fd0c6a None None] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:00:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Starting finish_revert_migration {{(pid=71364) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Start _get_guest_xml network_info=[{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dImUioOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5ff9bbaf-1a5e-4acd-aca3-d956728312cb', 'attached_at': '2023-04-11T22:00:49.000000', 'detached_at': '', 'volume_id': '5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 'serial': '5b60671b-b0ac-47d4-8d1a-8001771bd0ab'}, 'attachment_id': 'e6ce70cc-f188-4231-a354-08756b4c6174', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:00:49 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:00:49 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.objects.instance [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dImUioOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:00:49 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:00:49 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:00:49 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[de78293f-bf0c-4023-a2a4-6685efdb4e57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:00:49 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5617e547-4cbc-4f0a-9feb-6455b0d14b76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab] added
Apr 11 22:00:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae82ce44-f467-481f-81f9-7c4de842e445]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a96d208-024b-44d7-8ecc-760c06bdb09c]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dImUioOB {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dImUioOB" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[77550005-fbd4-4f7e-8ed9-cb3820564807]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dImUioOB'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb55f42-f6d4-4243-9105-8cae4b665534]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d963c0-9da0-4aca-9ce8-e9e0da41eedb]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:00:49 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 22:00:49 user nova-compute[71364]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:00:49 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:00:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:00:49 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 22:00:49 user nova-compute[71364]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:00:49 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:00:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[543ece1b-176a-4a42-af52-3d9b0a1505f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260]
Apr 11 22:00:49 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260] successful.
Apr 11 22:00:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd48ddc-470c-47d6-bce9-095374fa0401]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12d8b63-81a7-477f-9be5-836cc157fc41]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:00:49 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 22:00:49 user nova-compute[71364]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:00:49 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:00:49 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:00:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:00:49 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 22:00:49 user nova-compute[71364]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:00:49 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:00:49 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:00:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1441c8-a424-4006-b7ef-425232e2740d]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:00:49 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: None {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] There are 0 instances to clean {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dImUioOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23334386665363065', 'path': '/dev/sdd'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334386665363065', 'path': '/dev/sdd'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842337295',display_name='tempest-ServerActionsTestJSON-server-349398715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842337295',id=4,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-c34k408a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:00:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=5ff9bbaf-1a5e-4acd-aca3-d956728312cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:00:50 user nova-compute[71364]:   <uuid>5ff9bbaf-1a5e-4acd-aca3-d956728312cb</uuid>
Apr 11 22:00:50 user nova-compute[71364]:   <name>instance-00000004</name>
Apr 11 22:00:50 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:00:50 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:00:50 user nova-compute[71364]:   <metadata>
Apr 11 22:00:50 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:00:50 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:00:50 user nova-compute[71364]:       <nova:name>tempest-ServerActionsTestJSON-server-349398715</nova:name>
Apr 11 22:00:50 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:00:49</nova:creationTime>
Apr 11 22:00:50 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:00:50 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:00:50 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:00:50 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:00:50 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:00:50 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:00:50 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:00:50 user nova-compute[71364]:       <nova:owner>
Apr 11 22:00:50 user nova-compute[71364]:         <nova:user uuid="939785ef89cb491aae3df4f411b2543d">tempest-ServerActionsTestJSON-434853204-project-member</nova:user>
Apr 11 22:00:50 user nova-compute[71364]:         <nova:project uuid="c9fff7d112a94e7da6bf166a6f628fed">tempest-ServerActionsTestJSON-434853204</nova:project>
Apr 11 22:00:50 user nova-compute[71364]:       </nova:owner>
Apr 11 22:00:50 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:00:50 user nova-compute[71364]:       <nova:ports>
Apr 11 22:00:50 user nova-compute[71364]:         <nova:port uuid="6144f13d-b463-46ef-b75b-d2d982198b72">
Apr 11 22:00:50 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 22:00:50 user nova-compute[71364]:         </nova:port>
Apr 11 22:00:50 user nova-compute[71364]:       </nova:ports>
Apr 11 22:00:50 user nova-compute[71364]:     </nova:instance>
Apr 11 22:00:50 user nova-compute[71364]:   </metadata>
Apr 11 22:00:50 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:00:50 user nova-compute[71364]:     <system>
Apr 11 22:00:50 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:00:50 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:00:50 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:00:50 user nova-compute[71364]:       <entry name="serial">5ff9bbaf-1a5e-4acd-aca3-d956728312cb</entry>
Apr 11 22:00:50 user nova-compute[71364]:       <entry name="uuid">5ff9bbaf-1a5e-4acd-aca3-d956728312cb</entry>
Apr 11 22:00:50 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:00:50 user nova-compute[71364]:     </system>
Apr 11 22:00:50 user nova-compute[71364]:   </sysinfo>
Apr 11 22:00:50 user nova-compute[71364]:   <os>
Apr 11 22:00:50 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:00:50 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:00:50 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:00:50 user nova-compute[71364]:   </os>
Apr 11 22:00:50 user nova-compute[71364]:   <features>
Apr 11 22:00:50 user nova-compute[71364]:     <acpi/>
Apr 11 22:00:50 user nova-compute[71364]:     <apic/>
Apr 11 22:00:50 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:00:50 user nova-compute[71364]:   </features>
Apr 11 22:00:50 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:00:50 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:00:50 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:00:50 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:00:50 user nova-compute[71364]:   </clock>
Apr 11 22:00:50 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:00:50 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:00:50 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:00:50 user nova-compute[71364]:   </cpu>
Apr 11 22:00:50 user nova-compute[71364]:   <devices>
Apr 11 22:00:50 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:00:50 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:00:50 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk"/>
Apr 11 22:00:50 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:00:50 user nova-compute[71364]:     </disk>
Apr 11 22:00:50 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 22:00:50 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:00:50 user nova-compute[71364]:       <source dev="/dev/sdd"/>
Apr 11 22:00:50 user nova-compute[71364]:       <target dev="vdb" bus="virtio"/>
Apr 11 22:00:50 user nova-compute[71364]:       <serial>5b60671b-b0ac-47d4-8d1a-8001771bd0ab</serial>
Apr 11 22:00:50 user nova-compute[71364]:     </disk>
Apr 11 22:00:50 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:00:50 user nova-compute[71364]:       <mac address="fa:16:3e:44:2c:d8"/>
Apr 11 22:00:50 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:00:50 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:00:50 user nova-compute[71364]:       <target dev="tap6144f13d-b4"/>
Apr 11 22:00:50 user nova-compute[71364]:     </interface>
Apr 11 22:00:50 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:00:50 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/console.log" append="off"/>
Apr 11 22:00:50 user nova-compute[71364]:     </serial>
Apr 11 22:00:50 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:00:50 user nova-compute[71364]:     <video>
Apr 11 22:00:50 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:00:50 user nova-compute[71364]:     </video>
Apr 11 22:00:50 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:00:50 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:00:50 user nova-compute[71364]:     </rng>
Apr 11 22:00:50 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:00:50 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:00:50 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:00:50 user nova-compute[71364]:     </memballoon>
Apr 11 22:00:50 user nova-compute[71364]:   </devices>
Apr 11 22:00:50 user nova-compute[71364]: </domain>
Apr 11 22:00:50 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842337295',display_name='tempest-ServerActionsTestJSON-server-349398715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842337295',id=4,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:59:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-c34k408a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:00:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=5ff9bbaf-1a5e-4acd-aca3-d956728312cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG os_vif [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6144f13d-b4, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6144f13d-b4, col_values=(('external_ids', {'iface-id': '6144f13d-b463-46ef-b75b-d2d982198b72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:2c:d8', 'vm-uuid': '5ff9bbaf-1a5e-4acd-aca3-d956728312cb'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:00:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:50 user nova-compute[71364]: INFO os_vif [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4')
Apr 11 22:00:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-2b9a6604-6c17-4b9f-9ab8-ed3bc6803d6f req-bd5276bf-23d5-4bb0-be8d-e63e1f08d4c2 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2b9a6604-6c17-4b9f-9ab8-ed3bc6803d6f req-bd5276bf-23d5-4bb0-be8d-e63e1f08d4c2 service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2b9a6604-6c17-4b9f-9ab8-ed3bc6803d6f req-bd5276bf-23d5-4bb0-be8d-e63e1f08d4c2 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2b9a6604-6c17-4b9f-9ab8-ed3bc6803d6f req-bd5276bf-23d5-4bb0-be8d-e63e1f08d4c2 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-2b9a6604-6c17-4b9f-9ab8-ed3bc6803d6f req-bd5276bf-23d5-4bb0-be8d-e63e1f08d4c2 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:00:52 user nova-compute[71364]: WARNING nova.compute.manager [req-2b9a6604-6c17-4b9f-9ab8-ed3bc6803d6f req-bd5276bf-23d5-4bb0-be8d-e63e1f08d4c2 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state resized and task_state resize_reverting.
Apr 11 22:00:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:52 user nova-compute[71364]: INFO nova.compute.manager [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Unrescuing
Apr 11 22:00:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:00:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquired lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:00:52 user nova-compute[71364]: DEBUG nova.network.neutron [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:00:53 user nova-compute[71364]: DEBUG nova.network.neutron [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Updating instance_info_cache with network_info: [{"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:00:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Releasing lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:00:53 user nova-compute[71364]: DEBUG nova.objects.instance [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'flavor' on Instance uuid c48d8944-6010-4d8d-9761-6ee0d7cd005b {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:00:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-0601f09b-fa7f-4797-9f12-1919bc04a0e8 req-64ff7c40-e64f-4995-9c70-5a0d8370f970 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-vif-unplugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0601f09b-fa7f-4797-9f12-1919bc04a0e8 req-64ff7c40-e64f-4995-9c70-5a0d8370f970 service nova] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0601f09b-fa7f-4797-9f12-1919bc04a0e8 req-64ff7c40-e64f-4995-9c70-5a0d8370f970 service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0601f09b-fa7f-4797-9f12-1919bc04a0e8 req-64ff7c40-e64f-4995-9c70-5a0d8370f970 service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-0601f09b-fa7f-4797-9f12-1919bc04a0e8 req-64ff7c40-e64f-4995-9c70-5a0d8370f970 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] No waiting events found dispatching network-vif-unplugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:00:53 user nova-compute[71364]: WARNING nova.compute.manager [req-0601f09b-fa7f-4797-9f12-1919bc04a0e8 req-64ff7c40-e64f-4995-9c70-5a0d8370f970 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received unexpected event network-vif-unplugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:00:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-9727b5e0-5eb1-4bc3-8fa6-14952d3e2d32 req-490d900b-3c83-4178-b874-f0b8ea43ca7d service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9727b5e0-5eb1-4bc3-8fa6-14952d3e2d32 req-490d900b-3c83-4178-b874-f0b8ea43ca7d service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9727b5e0-5eb1-4bc3-8fa6-14952d3e2d32 req-490d900b-3c83-4178-b874-f0b8ea43ca7d service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9727b5e0-5eb1-4bc3-8fa6-14952d3e2d32 req-490d900b-3c83-4178-b874-f0b8ea43ca7d service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-9727b5e0-5eb1-4bc3-8fa6-14952d3e2d32 req-490d900b-3c83-4178-b874-f0b8ea43ca7d service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:00:54 user nova-compute[71364]: WARNING nova.compute.manager [req-9727b5e0-5eb1-4bc3-8fa6-14952d3e2d32 req-490d900b-3c83-4178-b874-f0b8ea43ca7d service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state resized and task_state resize_reverting.
Apr 11 22:00:54 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Instance destroyed successfully.
Apr 11 22:00:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for 5ff9bbaf-1a5e-4acd-aca3-d956728312cb due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250454.5343857, 5ff9bbaf-1a5e-4acd-aca3-d956728312cb => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:00:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] VM Resumed (Lifecycle Event)
Apr 11 22:00:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:00:54 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance running successfully.
Apr 11 22:00:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] finish_revert_migration finished successfully. {{(pid=71364) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:00:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 11 22:00:54 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250454.5366793, 5ff9bbaf-1a5e-4acd-aca3-d956728312cb => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:00:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] VM Started (Lifecycle Event)
Apr 11 22:00:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:00:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:00:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 11 22:00:54 user nova-compute[71364]: INFO nova.compute.manager [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating instance to original state: 'active'
Apr 11 22:00:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:55 user nova-compute[71364]: DEBUG nova.compute.manager [req-d5a65e83-bfcc-446b-a28a-ef240e87d8d3 req-34cd2806-3625-4098-adc1-e5f5e0dc3cd3 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d5a65e83-bfcc-446b-a28a-ef240e87d8d3 req-34cd2806-3625-4098-adc1-e5f5e0dc3cd3 service nova] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d5a65e83-bfcc-446b-a28a-ef240e87d8d3 req-34cd2806-3625-4098-adc1-e5f5e0dc3cd3 service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d5a65e83-bfcc-446b-a28a-ef240e87d8d3 req-34cd2806-3625-4098-adc1-e5f5e0dc3cd3 service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:55 user nova-compute[71364]: DEBUG nova.compute.manager [req-d5a65e83-bfcc-446b-a28a-ef240e87d8d3 req-34cd2806-3625-4098-adc1-e5f5e0dc3cd3 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] No waiting events found dispatching network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:00:55 user nova-compute[71364]: WARNING nova.compute.manager [req-d5a65e83-bfcc-446b-a28a-ef240e87d8d3 req-34cd2806-3625-4098-adc1-e5f5e0dc3cd3 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received unexpected event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:00:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:00:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:00:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] No waiting events found dispatching network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:00:57 user nova-compute[71364]: WARNING nova.compute.manager [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received unexpected event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:00:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] No waiting events found dispatching network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:00:57 user nova-compute[71364]: WARNING nova.compute.manager [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received unexpected event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:00:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for c48d8944-6010-4d8d-9761-6ee0d7cd005b due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250457.9003215, c48d8944-6010-4d8d-9761-6ee0d7cd005b => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:00:57 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] VM Resumed (Lifecycle Event)
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:00:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:00:58 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 22:00:58 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250457.9004776, c48d8944-6010-4d8d-9761-6ee0d7cd005b => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:00:58 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] VM Started (Lifecycle Event)
Apr 11 22:00:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:00:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:00:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:00:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:00:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:00:59 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:00:59 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:00:59 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7761MB free_disk=26.155902862548828GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:00:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:00:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3915859d-4e2f-4568-9b02-d0733a474749 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5366a438-0f96-4ae2-8c99-48f98501baa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing inventories for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating ProviderTree inventory for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating inventory in ProviderTree for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing aggregate associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, aggregates: None {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing trait associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.796s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71364) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:01:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:01:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:01:02 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:01:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:01:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:01:02 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:01:03 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Updating instance_info_cache with network_info: [{"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:01:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:01:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:01:03 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:01:03 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:01:03 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:01:03 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:01:03 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:01:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:01:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG nova.objects.instance [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'flavor' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquired lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG nova.network.neutron [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG nova.objects.instance [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'info_cache' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG nova.network.neutron [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Updating instance_info_cache with network_info: [{"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Releasing lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:01:08 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Instance destroyed successfully.
Apr 11 22:01:08 user nova-compute[71364]: DEBUG nova.objects.instance [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'resources' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-725789604',display_name='tempest-AttachVolumeTestJSON-server-725789604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-725789604',id=23,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYwKlNnt0rCNL8sjxDa6Udl9GHywucHycueHP/WPlPumIvAabJq5jTPAthhGusMxnokX9UxhPJGgZI9+13actfeG6CHskRBehNb6fTqc1ot1bspfEW3rpY449P/8ec+gw==',key_name='tempest-keypair-654553624',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5aa35cf81ae74532a074bde65f192848',ramdisk_id='',reservation_id='r-q3i4b0c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1865595781',owner_user_name='tempest-AttachVolumeTestJSON-1865595781-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76211a47ed9b4a8abdeeea98c774d3d7',uuid=53530e4f-a899-496d-8b83-a3b5f7dbc7ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converting VIF {"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG os_vif [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap914c7aea-32, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:01:08 user nova-compute[71364]: INFO os_vif [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32')
Apr 11 22:01:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMYJtIcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:01:08 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:01:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6c8391-0939-4885-aac3-2ae126402036]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:01:08 user nova-compute[71364]: No targets found.
Apr 11 22:01:08 user nova-compute[71364]: iSNS:
Apr 11 22:01:08 user nova-compute[71364]: No targets found.
Apr 11 22:01:08 user nova-compute[71364]: STATIC:
Apr 11 22:01:08 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:01:08 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:01:08 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:01:08 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab
Apr 11 22:01:08 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:01:08 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:01:08 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870
Apr 11 22:01:08 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:01:08 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:01:08 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44
Apr 11 22:01:08 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:01:08 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:01:08 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe
Apr 11 22:01:08 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:01:08 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:01:08 user nova-compute[71364]: FIRMWARE:
Apr 11 22:01:08 user nova-compute[71364]: No targets found.
Apr 11 22:01:08 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:01:08 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:01:08 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35e14e1-5335-457e-861a-5f060ee34e4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[38420509-789d-4708-a999-4c9ebaf1328c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:01:08 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 22:01:08 user nova-compute[71364]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:01:08 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:01:08 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:01:08 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:01:08 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 22:01:08 user nova-compute[71364]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:01:08 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:01:08 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:01:08 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff7a2cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe'): ({'sde'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Removing single pathed devices sde {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6e8433-8b55-44b9-8bf5-ed85927c0747]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ef182d-c267-4a34-99b8-468eb70cb9f2]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flushing IO for device /dev/sde {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[320b8779-6b98-47bc-8de7-1bba59ea77ef]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b777883-0f8e-4f95-9a67-0d5b351cdf86]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e189872c-a553-483f-930a-a9f47ef75ee1]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[43140b72-0ef2-4d3a-b7a0-6e17dbc7afcf]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260]
Apr 11 22:01:09 user nova-compute[71364]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260] successful.
Apr 11 22:01:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b8565f-02f4-4e67-8bb0-4f5c108568f7]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] <== disconnect_volume: return (299ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Start _get_guest_xml network_info=[{"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMYJtIcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '53530e4f-a899-496d-8b83-a3b5f7dbc7ea', 'attached_at': '', 'detached_at': '', 'volume_id': '594600b9-5a65-44f7-9a8c-c741f0ef19fe', 'serial': '594600b9-5a65-44f7-9a8c-c741f0ef19fe'}, 'attachment_id': '3c657777-a966-4b24-b0f8-3f0659bf9627', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.objects.instance [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'numa_topology' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:01:09 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:01:09 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.objects.instance [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'vcpu_model' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMYJtIcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:01:09 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:01:09 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:01:09 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf4e5cf-6aaa-40cb-a426-09a47db7c9e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:01:09 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[371110a9-f700-439a-9404-5e77d9eccebb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe] added
Apr 11 22:01:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26919ac-1cb5-409e-8382-1fd0c24ef318]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b16e6b-19da-48b0-9659-7c8ef45730d0]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMYJtIcb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMYJtIcb" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d62db40-4cfe-46ef-ac02-ba9babcc1ccc]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BMYJtIcb'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfadc3bb-5862-4134-8bdd-0e45c5881f04]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f2a130-2ff0-4502-bb0b-ce0a42818718]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:01:09 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 22:01:09 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:01:09 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:01:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:01:09 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 22:01:09 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:01:09 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:01:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3a7a97-8d3e-428a-8df0-ec06b90530f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260]
Apr 11 22:01:09 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260] successful.
Apr 11 22:01:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[218e16a3-0506-49d4-8c8e-b0ba954b9924]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b327ccb0-8410-4583-b704-71253cc7ceb1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:01:09 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 22:01:09 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:01:09 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:01:09 user nova-compute[71364]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:01:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:01:09 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 22:01:09 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:01:09 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:01:09 user nova-compute[71364]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:01:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d867065c-2110-4dec-940c-d8753e566bdb]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:01:10 user nova-compute[71364]: INFO nova.compute.manager [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Unrescuing
Apr 11 22:01:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquired lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG nova.network.neutron [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMYJtIcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23165363164316237', 'path': '/dev/sde'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165363164316237', 'path': '/dev/sde'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-725789604',display_name='tempest-AttachVolumeTestJSON-server-725789604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-725789604',id=23,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYwKlNnt0rCNL8sjxDa6Udl9GHywucHycueHP/WPlPumIvAabJq5jTPAthhGusMxnokX9UxhPJGgZI9+13actfeG6CHskRBehNb6fTqc1ot1bspfEW3rpY449P/8ec+gw==',key_name='tempest-keypair-654553624',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5aa35cf81ae74532a074bde65f192848',ramdisk_id='',reservation_id='r-q3i4b0c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1865595781',owner_user_name='tempest-AttachVolumeTestJSON-1865595781-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76211a47ed9b4a8abdeeea98c774d3d7',uuid=53530e4f-a899-496d-8b83-a3b5f7dbc7ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converting VIF {"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG nova.objects.instance [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'pci_devices' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:01:10 user nova-compute[71364]:   <uuid>53530e4f-a899-496d-8b83-a3b5f7dbc7ea</uuid>
Apr 11 22:01:10 user nova-compute[71364]:   <name>instance-00000017</name>
Apr 11 22:01:10 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:01:10 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:01:10 user nova-compute[71364]:   <metadata>
Apr 11 22:01:10 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:01:10 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:01:10 user nova-compute[71364]:       <nova:name>tempest-AttachVolumeTestJSON-server-725789604</nova:name>
Apr 11 22:01:10 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:01:09</nova:creationTime>
Apr 11 22:01:10 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:01:10 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:01:10 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:01:10 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:01:10 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:01:10 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:01:10 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:01:10 user nova-compute[71364]:       <nova:owner>
Apr 11 22:01:10 user nova-compute[71364]:         <nova:user uuid="76211a47ed9b4a8abdeeea98c774d3d7">tempest-AttachVolumeTestJSON-1865595781-project-member</nova:user>
Apr 11 22:01:10 user nova-compute[71364]:         <nova:project uuid="5aa35cf81ae74532a074bde65f192848">tempest-AttachVolumeTestJSON-1865595781</nova:project>
Apr 11 22:01:10 user nova-compute[71364]:       </nova:owner>
Apr 11 22:01:10 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:01:10 user nova-compute[71364]:       <nova:ports>
Apr 11 22:01:10 user nova-compute[71364]:         <nova:port uuid="914c7aea-325c-4061-893a-353590f63b84">
Apr 11 22:01:10 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 22:01:10 user nova-compute[71364]:         </nova:port>
Apr 11 22:01:10 user nova-compute[71364]:       </nova:ports>
Apr 11 22:01:10 user nova-compute[71364]:     </nova:instance>
Apr 11 22:01:10 user nova-compute[71364]:   </metadata>
Apr 11 22:01:10 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:01:10 user nova-compute[71364]:     <system>
Apr 11 22:01:10 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:01:10 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:01:10 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:01:10 user nova-compute[71364]:       <entry name="serial">53530e4f-a899-496d-8b83-a3b5f7dbc7ea</entry>
Apr 11 22:01:10 user nova-compute[71364]:       <entry name="uuid">53530e4f-a899-496d-8b83-a3b5f7dbc7ea</entry>
Apr 11 22:01:10 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:01:10 user nova-compute[71364]:     </system>
Apr 11 22:01:10 user nova-compute[71364]:   </sysinfo>
Apr 11 22:01:10 user nova-compute[71364]:   <os>
Apr 11 22:01:10 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:01:10 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:01:10 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:01:10 user nova-compute[71364]:   </os>
Apr 11 22:01:10 user nova-compute[71364]:   <features>
Apr 11 22:01:10 user nova-compute[71364]:     <acpi/>
Apr 11 22:01:10 user nova-compute[71364]:     <apic/>
Apr 11 22:01:10 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:01:10 user nova-compute[71364]:   </features>
Apr 11 22:01:10 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:01:10 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:01:10 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:01:10 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:01:10 user nova-compute[71364]:   </clock>
Apr 11 22:01:10 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:01:10 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:01:10 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:01:10 user nova-compute[71364]:   </cpu>
Apr 11 22:01:10 user nova-compute[71364]:   <devices>
Apr 11 22:01:10 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:01:10 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:01:10 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk"/>
Apr 11 22:01:10 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:01:10 user nova-compute[71364]:     </disk>
Apr 11 22:01:10 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 22:01:10 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:01:10 user nova-compute[71364]:       <source dev="/dev/sde"/>
Apr 11 22:01:10 user nova-compute[71364]:       <target dev="vdb" bus="virtio"/>
Apr 11 22:01:10 user nova-compute[71364]:       <serial>594600b9-5a65-44f7-9a8c-c741f0ef19fe</serial>
Apr 11 22:01:10 user nova-compute[71364]:     </disk>
Apr 11 22:01:10 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:01:10 user nova-compute[71364]:       <mac address="fa:16:3e:fb:64:5e"/>
Apr 11 22:01:10 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:01:10 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:01:10 user nova-compute[71364]:       <target dev="tap914c7aea-32"/>
Apr 11 22:01:10 user nova-compute[71364]:     </interface>
Apr 11 22:01:10 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:01:10 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/console.log" append="off"/>
Apr 11 22:01:10 user nova-compute[71364]:     </serial>
Apr 11 22:01:10 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:01:10 user nova-compute[71364]:     <video>
Apr 11 22:01:10 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:01:10 user nova-compute[71364]:     </video>
Apr 11 22:01:10 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:01:10 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:01:10 user nova-compute[71364]:     </rng>
Apr 11 22:01:10 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:01:10 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:01:10 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:01:10 user nova-compute[71364]:     </memballoon>
Apr 11 22:01:10 user nova-compute[71364]:   </devices>
Apr 11 22:01:10 user nova-compute[71364]: </domain>
Apr 11 22:01:10 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG nova.network.neutron [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Updating instance_info_cache with network_info: [{"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Releasing lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG nova.objects.instance [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'flavor' on Instance uuid b66951a9-73f3-41ce-9f19-b4e5e24d61b0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG nova.objects.instance [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'trusted_certs' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:01:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.151s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-dca41dcf-4abb-4a51-8ef9-b06bcb632c52 req-bacf88fd-5a9d-4768-aa0e-ffbd18be3a23 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-vif-unplugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-dca41dcf-4abb-4a51-8ef9-b06bcb632c52 req-bacf88fd-5a9d-4768-aa0e-ffbd18be3a23 service nova] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-dca41dcf-4abb-4a51-8ef9-b06bcb632c52 req-bacf88fd-5a9d-4768-aa0e-ffbd18be3a23 service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-dca41dcf-4abb-4a51-8ef9-b06bcb632c52 req-bacf88fd-5a9d-4768-aa0e-ffbd18be3a23 service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-dca41dcf-4abb-4a51-8ef9-b06bcb632c52 req-bacf88fd-5a9d-4768-aa0e-ffbd18be3a23 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] No waiting events found dispatching network-vif-unplugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:01:11 user nova-compute[71364]: WARNING nova.compute.manager [req-dca41dcf-4abb-4a51-8ef9-b06bcb632c52 req-bacf88fd-5a9d-4768-aa0e-ffbd18be3a23 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received unexpected event network-vif-unplugged-809749e4-0885-4825-8976-660b2c0bcca7 for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:01:11 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Cannot resize image /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG nova.objects.instance [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'migration_context' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-725789604',display_name='tempest-AttachVolumeTestJSON-server-725789604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-725789604',id=23,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYwKlNnt0rCNL8sjxDa6Udl9GHywucHycueHP/WPlPumIvAabJq5jTPAthhGusMxnokX9UxhPJGgZI9+13actfeG6CHskRBehNb6fTqc1ot1bspfEW3rpY449P/8ec+gw==',key_name='tempest-keypair-654553624',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5aa35cf81ae74532a074bde65f192848',ramdisk_id='',reservation_id='r-q3i4b0c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1865595781',owner_user_name='tempest-AttachVolumeTestJSON-1865595781-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T21:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76211a47ed9b4a8abdeeea98c774d3d7',uuid=53530e4f-a899-496d-8b83-a3b5f7dbc7ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converting VIF {"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG os_vif [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap914c7aea-32, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap914c7aea-32, col_values=(('external_ids', {'iface-id': '914c7aea-325c-4061-893a-353590f63b84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:64:5e', 'vm-uuid': '53530e4f-a899-496d-8b83-a3b5f7dbc7ea'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:01:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:11 user nova-compute[71364]: INFO os_vif [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32')
Apr 11 22:01:11 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Instance destroyed successfully.
Apr 11 22:01:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-4347b2c0-b59a-4c47-815f-344ab0f6b515 req-f733fe53-6cf1-4b9d-8b6d-ab9c614d09b3 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4347b2c0-b59a-4c47-815f-344ab0f6b515 req-f733fe53-6cf1-4b9d-8b6d-ab9c614d09b3 service nova] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4347b2c0-b59a-4c47-815f-344ab0f6b515 req-f733fe53-6cf1-4b9d-8b6d-ab9c614d09b3 service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4347b2c0-b59a-4c47-815f-344ab0f6b515 req-f733fe53-6cf1-4b9d-8b6d-ab9c614d09b3 service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-4347b2c0-b59a-4c47-815f-344ab0f6b515 req-f733fe53-6cf1-4b9d-8b6d-ab9c614d09b3 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] No waiting events found dispatching network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:01:13 user nova-compute[71364]: WARNING nova.compute.manager [req-4347b2c0-b59a-4c47-815f-344ab0f6b515 req-f733fe53-6cf1-4b9d-8b6d-ab9c614d09b3 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received unexpected event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:01:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-9114b1cb-6485-4285-b791-09cab51b79aa req-c8b69c7f-8a38-49f7-b201-d43b5f757dd9 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9114b1cb-6485-4285-b791-09cab51b79aa req-c8b69c7f-8a38-49f7-b201-d43b5f757dd9 service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9114b1cb-6485-4285-b791-09cab51b79aa req-c8b69c7f-8a38-49f7-b201-d43b5f757dd9 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9114b1cb-6485-4285-b791-09cab51b79aa req-c8b69c7f-8a38-49f7-b201-d43b5f757dd9 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-9114b1cb-6485-4285-b791-09cab51b79aa req-c8b69c7f-8a38-49f7-b201-d43b5f757dd9 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:01:13 user nova-compute[71364]: WARNING nova.compute.manager [req-9114b1cb-6485-4285-b791-09cab51b79aa req-c8b69c7f-8a38-49f7-b201-d43b5f757dd9 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state stopped and task_state powering-on.
Apr 11 22:01:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] No waiting events found dispatching network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:01:15 user nova-compute[71364]: WARNING nova.compute.manager [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received unexpected event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:01:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] No waiting events found dispatching network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:01:15 user nova-compute[71364]: WARNING nova.compute.manager [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received unexpected event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:01:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-78f9e7a8-7973-4421-a56b-b6798c656b29 req-19424cc7-10f9-4a09-809b-7972fa602bc5 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-78f9e7a8-7973-4421-a56b-b6798c656b29 req-19424cc7-10f9-4a09-809b-7972fa602bc5 service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-78f9e7a8-7973-4421-a56b-b6798c656b29 req-19424cc7-10f9-4a09-809b-7972fa602bc5 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-78f9e7a8-7973-4421-a56b-b6798c656b29 req-19424cc7-10f9-4a09-809b-7972fa602bc5 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-78f9e7a8-7973-4421-a56b-b6798c656b29 req-19424cc7-10f9-4a09-809b-7972fa602bc5 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:01:15 user nova-compute[71364]: WARNING nova.compute.manager [req-78f9e7a8-7973-4421-a56b-b6798c656b29 req-19424cc7-10f9-4a09-809b-7972fa602bc5 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state stopped and task_state powering-on.
Apr 11 22:01:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250476.267089, 53530e4f-a899-496d-8b83-a3b5f7dbc7ea => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:01:16 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] VM Resumed (Lifecycle Event)
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:01:16 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Instance rebooted successfully.
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:01:16 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250476.2692914, 53530e4f-a899-496d-8b83-a3b5f7dbc7ea => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:01:16 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] VM Started (Lifecycle Event)
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for b66951a9-73f3-41ce-9f19-b4e5e24d61b0 due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250476.2695122, b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:01:16 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] VM Resumed (Lifecycle Event)
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250476.2703009, b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:01:16 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] VM Started (Lifecycle Event)
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:01:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:01:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:20 user nova-compute[71364]: INFO nova.compute.manager [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Detaching volume a1ca3af8-39b5-45e4-83f1-682191717870
Apr 11 22:01:20 user nova-compute[71364]: INFO nova.virt.block_device [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Attempting to driver detach volume a1ca3af8-39b5-45e4-83f1-682191717870 from mountpoint /dev/vdb
Apr 11 22:01:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Attempting to detach device vdb from instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:01:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:01:20 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:01:20 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:01:20 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:01:20 user nova-compute[71364]:   <serial>a1ca3af8-39b5-45e4-83f1-682191717870</serial>
Apr 11 22:01:20 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:01:20 user nova-compute[71364]: </disk>
Apr 11 22:01:20 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:01:20 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Successfully detached device vdb from instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 from the persistent domain config.
Apr 11 22:01:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:01:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:01:20 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:01:20 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:01:20 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:01:20 user nova-compute[71364]:   <serial>a1ca3af8-39b5-45e4-83f1-682191717870</serial>
Apr 11 22:01:20 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:01:20 user nova-compute[71364]: </disk>
Apr 11 22:01:20 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681250481.285678, cc39cc0e-7829-408b-8477-0c57d8bfa2c5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:01:21 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Successfully detached device vdb from instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 from the live domain config.
Apr 11 22:01:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GLKSqIaj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:01:21 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6759bab-8cb2-4a02-a02d-0c259b8382e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:01:21 user nova-compute[71364]: No targets found.
Apr 11 22:01:21 user nova-compute[71364]: iSNS:
Apr 11 22:01:21 user nova-compute[71364]: No targets found.
Apr 11 22:01:21 user nova-compute[71364]: STATIC:
Apr 11 22:01:21 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:01:21 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:01:21 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:01:21 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab
Apr 11 22:01:21 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:01:21 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:01:21 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870
Apr 11 22:01:21 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:01:21 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:01:21 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44
Apr 11 22:01:21 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:01:21 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:01:21 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe
Apr 11 22:01:21 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:01:21 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:01:21 user nova-compute[71364]: FIRMWARE:
Apr 11 22:01:21 user nova-compute[71364]: No targets found.
Apr 11 22:01:21 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:01:21 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:01:21 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f720acb-8216-4c35-9412-aadf4db01ef3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca7381f-1646-411d-b8ef-b402fb6575f5]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:01:21 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 22:01:21 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:01:21 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:01:21 user nova-compute[71364]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:01:21 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:01:21 user nova-compute[71364]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 (non-flash)
Apr 11 22:01:21 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:01:21 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:01:21 user nova-compute[71364]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:01:21 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff756e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a347f55e-8240-4146-b511-f1d30bfe78c5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccc84dd-1e62-48dd-9480-615c4c33a18f]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c0703d-325b-426b-b766-850285e204a1]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5184dea-7b80-4f95-b460-77510d7822cc]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ce72bc-9700-44b1-b476-db7f0af06304]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[130c91ea-c1eb-45f6-a9c9-1b1ce479bbaa]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870, portal: 172.16.0.220,3260]
Apr 11 22:01:21 user nova-compute[71364]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870, portal: 172.16.0.220,3260] successful.
Apr 11 22:01:21 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1ca3af8-39b5-45e4-83f1-682191717870 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb3f4b7-1ab3-48fc-bd61-f062c913e0b6]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] <== disconnect_volume: return (305ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:01:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:01:22 user nova-compute[71364]: DEBUG nova.objects.instance [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'flavor' on Instance uuid cc39cc0e-7829-408b-8477-0c57d8bfa2c5 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:01:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.672s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-b957f98b-0a33-444f-9914-0d58cda3ca9b req-e38f4d9c-c9b8-432b-8eeb-3796c305cdfb service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-changed-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-b957f98b-0a33-444f-9914-0d58cda3ca9b req-e38f4d9c-c9b8-432b-8eeb-3796c305cdfb service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Refreshing instance network info cache due to event network-changed-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b957f98b-0a33-444f-9914-0d58cda3ca9b req-e38f4d9c-c9b8-432b-8eeb-3796c305cdfb service nova] Acquiring lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b957f98b-0a33-444f-9914-0d58cda3ca9b req-e38f4d9c-c9b8-432b-8eeb-3796c305cdfb service nova] Acquired lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-b957f98b-0a33-444f-9914-0d58cda3ca9b req-e38f4d9c-c9b8-432b-8eeb-3796c305cdfb service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Refreshing network info cache for port 5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "3915859d-4e2f-4568-9b02-d0733a474749" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:31 user nova-compute[71364]: INFO nova.compute.manager [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Terminating instance
Apr 11 22:01:31 user nova-compute[71364]: DEBUG nova.compute.manager [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG nova.network.neutron [req-b957f98b-0a33-444f-9914-0d58cda3ca9b req-e38f4d9c-c9b8-432b-8eeb-3796c305cdfb service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updated VIF entry in instance network info cache for port 5ea4b5fb-b111-488e-b1e4-15e0a63b3b83. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG nova.network.neutron [req-b957f98b-0a33-444f-9914-0d58cda3ca9b req-e38f4d9c-c9b8-432b-8eeb-3796c305cdfb service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updating instance_info_cache with network_info: [{"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b957f98b-0a33-444f-9914-0d58cda3ca9b req-e38f4d9c-c9b8-432b-8eeb-3796c305cdfb service nova] Releasing lock "refresh_cache-3915859d-4e2f-4568-9b02-d0733a474749" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:32 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Instance destroyed successfully.
Apr 11 22:01:32 user nova-compute[71364]: DEBUG nova.objects.instance [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lazy-loading 'resources' on Instance uuid 3915859d-4e2f-4568-9b02-d0733a474749 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T21:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-115257149',display_name='tempest-TestShelveInstance-server-115257149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-115257149',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyPTe9feerqVheMVPWgzAKCwaFOC9ArUtF6J+R4E3viM31y/cbRBAgN/fGGscghWK4rwcLJmmvX/JrdODSYEj5x0YZG9e58kVgIYJHTsbGEhKAGRr3PK3K9OZefO9EywQ==',key_name='tempest-TestShelveInstance-413583393',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:59:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6204710ef9e04099a7397acd2b027f15',ramdisk_id='',reservation_id='r-4z4pjiv6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2116780630',owner_user_name='tempest-TestShelveInstance-2116780630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:59:52Z,user_data=None,user_id='f1eb9c1fa13245dfbf9cdecd163e8e21',uuid=3915859d-4e2f-4568-9b02-d0733a474749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Converting VIF {"id": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "address": "fa:16:3e:69:cd:e6", "network": {"id": "2fa04b01-8810-4143-8c46-44a06e013c98", "bridge": "br-int", "label": "tempest-TestShelveInstance-2082275724-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6204710ef9e04099a7397acd2b027f15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea4b5fb-b1", "ovs_interfaceid": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83,network=Network(2fa04b01-8810-4143-8c46-44a06e013c98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea4b5fb-b1') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_vif [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83,network=Network(2fa04b01-8810-4143-8c46-44a06e013c98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea4b5fb-b1') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ea4b5fb-b1, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:01:32 user nova-compute[71364]: INFO os_vif [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:cd:e6,bridge_name='br-int',has_traffic_filtering=True,id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83,network=Network(2fa04b01-8810-4143-8c46-44a06e013c98),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea4b5fb-b1')
Apr 11 22:01:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yQEUSMDw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:01:32 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae19a50-bc2d-4158-adcf-05bd567abee5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:01:32 user nova-compute[71364]: No targets found.
Apr 11 22:01:32 user nova-compute[71364]: iSNS:
Apr 11 22:01:32 user nova-compute[71364]: No targets found.
Apr 11 22:01:32 user nova-compute[71364]: STATIC:
Apr 11 22:01:32 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:01:32 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:01:32 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:01:32 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab
Apr 11 22:01:32 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:01:32 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:01:32 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44
Apr 11 22:01:32 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:01:32 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:01:32 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe
Apr 11 22:01:32 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:01:32 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:01:32 user nova-compute[71364]: FIRMWARE:
Apr 11 22:01:32 user nova-compute[71364]: No targets found.
Apr 11 22:01:32 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:01:32 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:01:32 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba470940-1aed-4f93-9ccd-45503e55396d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7584784e-7386-4ae0-8860-13be87f7d73c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:01:32 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:01:32 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:01:32 user nova-compute[71364]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:01:32 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:01:32 user nova-compute[71364]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 (non-flash)
Apr 11 22:01:32 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:01:32 user nova-compute[71364]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:01:32 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4baccb0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44'): ({'sdf'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Removing single pathed devices sdf {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ce6896-7edd-4274-ae2e-beb7341692ca]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc5f86f-d29a-454d-88c0-3cf2e569db8f]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Flushing IO for device /dev/sdf {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a4fa61-6afd-4966-93dc-ac683e9cba36]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b235f54a-d5b2-42ad-8b0c-a3a9977ee263]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] SCSI volumes sdf have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f34abb94', '/dev/disk/by-id/scsi-1SCST_BIOf34abb94-4432f558611a9d47', '/dev/disk/by-id/scsi-23434333266353538') {{(pid=81576) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[64378d6b-a1fd-46c7-a252-ebb552cbf4c6]: (4, None) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a585bc50-65e3-4acf-b83d-9784a6d2c8d9]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af500a7-ed27-4848-9758-21a329e2168c]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260]
Apr 11 22:01:32 user nova-compute[71364]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44, portal: 172.16.0.220,3260] successful.
Apr 11 22:01:32 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f165ecee-978a-47fa-a8ae-bee74bf26b44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f3f7dc-34d4-4f5d-beeb-6012b32d8425]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] <== disconnect_volume: return (352ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:01:32 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Deleting instance files /opt/stack/data/nova/instances/3915859d-4e2f-4568-9b02-d0733a474749_del
Apr 11 22:01:32 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Deletion of /opt/stack/data/nova/instances/3915859d-4e2f-4568-9b02-d0733a474749_del complete
Apr 11 22:01:32 user nova-compute[71364]: INFO nova.compute.manager [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Took 1.24 seconds to destroy the instance on the hypervisor.
Apr 11 22:01:32 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:01:32 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:01:33 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Took 0.60 seconds to deallocate network for instance.
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-ca24addc-b3ca-4059-8aca-9ce2b72d3eef req-f4b5a71b-8637-40e8-b61d-f6617fd3a200 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-deleted-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:33 user nova-compute[71364]: INFO nova.compute.manager [req-ca24addc-b3ca-4059-8aca-9ce2b72d3eef req-f4b5a71b-8637-40e8-b61d-f6617fd3a200 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Neutron deleted interface 5ea4b5fb-b111-488e-b1e4-15e0a63b3b83; detaching it from the instance and deleting it from the info cache
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.network.neutron [req-ca24addc-b3ca-4059-8aca-9ce2b72d3eef req-f4b5a71b-8637-40e8-b61d-f6617fd3a200 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-ca24addc-b3ca-4059-8aca-9ce2b72d3eef req-f4b5a71b-8637-40e8-b61d-f6617fd3a200 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Detach interface failed, port_id=5ea4b5fb-b111-488e-b1e4-15e0a63b3b83, reason: Instance 3915859d-4e2f-4568-9b02-d0733a474749 could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-unplugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] No waiting events found dispatching network-vif-unplugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-unplugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] No waiting events found dispatching network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:01:33 user nova-compute[71364]: WARNING nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received unexpected event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance with vm_state active and task_state deleting.
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] No waiting events found dispatching network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:01:33 user nova-compute[71364]: WARNING nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received unexpected event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance with vm_state active and task_state deleting.
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] No waiting events found dispatching network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:01:33 user nova-compute[71364]: WARNING nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received unexpected event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance with vm_state active and task_state deleting.
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-unplugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] No waiting events found dispatching network-vif-unplugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-unplugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Acquiring lock "3915859d-4e2f-4568-9b02-d0733a474749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Lock "3915859d-4e2f-4568-9b02-d0733a474749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] No waiting events found dispatching network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:01:33 user nova-compute[71364]: WARNING nova.compute.manager [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Received unexpected event network-vif-plugged-5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance with vm_state active and task_state deleting.
Apr 11 22:01:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:34 user nova-compute[71364]: INFO nova.compute.manager [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Took 0.85 seconds to detach 1 volumes for instance.
Apr 11 22:01:34 user nova-compute[71364]: DEBUG nova.compute.manager [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Deleting volume: f165ecee-978a-47fa-a8ae-bee74bf26b44 {{(pid=71364) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 22:01:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:34 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:01:34 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:01:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:34 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Deleted allocations for instance 3915859d-4e2f-4568-9b02-d0733a474749
Apr 11 22:01:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "3915859d-4e2f-4568-9b02-d0733a474749" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.282s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:47 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250492.3883903, 3915859d-4e2f-4568-9b02-d0733a474749 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:01:47 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] VM Stopped (Lifecycle Event)
Apr 11 22:01:47 user nova-compute[71364]: DEBUG nova.compute.manager [None req-86c02486-a630-478a-8a80-5f814d49ff58 None None] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:01:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:47 user nova-compute[71364]: INFO nova.compute.manager [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Terminating instance
Apr 11 22:01:47 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:01:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-0ca51469-3840-42e9-a0ec-0854b5abd174 req-4b9b6204-6857-4ccb-852d-3751bd7aff4f service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Received event network-vif-unplugged-99a12765-8c07-4345-9894-fc69ca59986f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0ca51469-3840-42e9-a0ec-0854b5abd174 req-4b9b6204-6857-4ccb-852d-3751bd7aff4f service nova] Acquiring lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0ca51469-3840-42e9-a0ec-0854b5abd174 req-4b9b6204-6857-4ccb-852d-3751bd7aff4f service nova] Lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0ca51469-3840-42e9-a0ec-0854b5abd174 req-4b9b6204-6857-4ccb-852d-3751bd7aff4f service nova] Lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-0ca51469-3840-42e9-a0ec-0854b5abd174 req-4b9b6204-6857-4ccb-852d-3751bd7aff4f service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] No waiting events found dispatching network-vif-unplugged-99a12765-8c07-4345-9894-fc69ca59986f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-0ca51469-3840-42e9-a0ec-0854b5abd174 req-4b9b6204-6857-4ccb-852d-3751bd7aff4f service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Received event network-vif-unplugged-99a12765-8c07-4345-9894-fc69ca59986f for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:01:48 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Instance destroyed successfully.
Apr 11 22:01:48 user nova-compute[71364]: DEBUG nova.objects.instance [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lazy-loading 'resources' on Instance uuid 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:59:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-609880783',display_name='tempest-VolumesActionsTest-instance-609880783',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-609880783',id=25,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:00:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf1f96aca4e547ef93d0d811ab4a8840',ramdisk_id='',reservation_id='r-kdhdqhpz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-214311813',owner_user_name='tempest-VolumesActionsTest-214311813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:00:04Z,user_data=None,user_id='c88df8be325448df9b24d49c3a7f6504',uuid=1da9a03b-9918-4b39-9a15-6cb7e5a2a967,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99a12765-8c07-4345-9894-fc69ca59986f", "address": "fa:16:3e:9c:f3:95", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a12765-8c", "ovs_interfaceid": "99a12765-8c07-4345-9894-fc69ca59986f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Converting VIF {"id": "99a12765-8c07-4345-9894-fc69ca59986f", "address": "fa:16:3e:9c:f3:95", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99a12765-8c", "ovs_interfaceid": "99a12765-8c07-4345-9894-fc69ca59986f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=99a12765-8c07-4345-9894-fc69ca59986f,network=Network(0c9b930b-ce00-4ef1-9c4f-057d0212e71d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a12765-8c') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG os_vif [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=99a12765-8c07-4345-9894-fc69ca59986f,network=Network(0c9b930b-ce00-4ef1-9c4f-057d0212e71d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a12765-8c') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99a12765-8c, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:48 user nova-compute[71364]: INFO os_vif [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f3:95,bridge_name='br-int',has_traffic_filtering=True,id=99a12765-8c07-4345-9894-fc69ca59986f,network=Network(0c9b930b-ce00-4ef1-9c4f-057d0212e71d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99a12765-8c')
Apr 11 22:01:48 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Deleting instance files /opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967_del
Apr 11 22:01:48 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Deletion of /opt/stack/data/nova/instances/1da9a03b-9918-4b39-9a15-6cb7e5a2a967_del complete
Apr 11 22:01:48 user nova-compute[71364]: INFO nova.compute.manager [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 11 22:01:48 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:01:48 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Took 0.42 seconds to deallocate network for instance.
Apr 11 22:01:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-82345a74-9dd5-49c3-a4fe-b10c99643ef1 req-62b61ecd-8f04-4684-8060-8d7d9970d67f service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Received event network-vif-deleted-99a12765-8c07-4345-9894-fc69ca59986f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:48 user nova-compute[71364]: INFO nova.compute.manager [req-82345a74-9dd5-49c3-a4fe-b10c99643ef1 req-62b61ecd-8f04-4684-8060-8d7d9970d67f service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Neutron deleted interface 99a12765-8c07-4345-9894-fc69ca59986f; detaching it from the instance and deleting it from the info cache
Apr 11 22:01:48 user nova-compute[71364]: DEBUG nova.network.neutron [req-82345a74-9dd5-49c3-a4fe-b10c99643ef1 req-62b61ecd-8f04-4684-8060-8d7d9970d67f service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-82345a74-9dd5-49c3-a4fe-b10c99643ef1 req-62b61ecd-8f04-4684-8060-8d7d9970d67f service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Detach interface failed, port_id=99a12765-8c07-4345-9894-fc69ca59986f, reason: Instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:49 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:01:49 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:01:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:49 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Deleted allocations for instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967
Apr 11 22:01:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.556s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-cc46ea3a-89bc-4ce1-8cac-e50e6d8c13b0 req-83b57cbd-8623-4aa2-8168-83ef3f1e968f service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Received event network-vif-plugged-99a12765-8c07-4345-9894-fc69ca59986f {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:01:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-cc46ea3a-89bc-4ce1-8cac-e50e6d8c13b0 req-83b57cbd-8623-4aa2-8168-83ef3f1e968f service nova] Acquiring lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-cc46ea3a-89bc-4ce1-8cac-e50e6d8c13b0 req-83b57cbd-8623-4aa2-8168-83ef3f1e968f service nova] Lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-cc46ea3a-89bc-4ce1-8cac-e50e6d8c13b0 req-83b57cbd-8623-4aa2-8168-83ef3f1e968f service nova] Lock "1da9a03b-9918-4b39-9a15-6cb7e5a2a967-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-cc46ea3a-89bc-4ce1-8cac-e50e6d8c13b0 req-83b57cbd-8623-4aa2-8168-83ef3f1e968f service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] No waiting events found dispatching network-vif-plugged-99a12765-8c07-4345-9894-fc69ca59986f {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:01:50 user nova-compute[71364]: WARNING nova.compute.manager [req-cc46ea3a-89bc-4ce1-8cac-e50e6d8c13b0 req-83b57cbd-8623-4aa2-8168-83ef3f1e968f service nova] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Received unexpected event network-vif-plugged-99a12765-8c07-4345-9894-fc69ca59986f for instance with vm_state deleted and task_state None.
Apr 11 22:01:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.126s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:55 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:01:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:01:58 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:01:58 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:01:58 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7762MB free_disk=26.188793182373047GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5366a438-0f96-4ae2-8c99-48f98501baa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:01:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:01:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-cc39cc0e-7829-408b-8477-0c57d8bfa2c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-cc39cc0e-7829-408b-8477-0c57d8bfa2c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Updating instance_info_cache with network_info: [{"id": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "address": "fa:16:3e:7d:db:0d", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d06f000-36", "ovs_interfaceid": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-cc39cc0e-7829-408b-8477-0c57d8bfa2c5" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:02:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:02:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:02:03 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250508.4306026, 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:02:03 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] VM Stopped (Lifecycle Event)
Apr 11 22:02:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ef3d685d-24e3-4f87-9583-d3fa96295675 None None] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:02:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:11 user nova-compute[71364]: INFO nova.compute.manager [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Terminating instance
Apr 11 22:02:11 user nova-compute[71364]: DEBUG nova.compute.manager [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-3f6c232b-0c96-4f9e-beec-7a1bae49c921 req-6077a93c-0596-41fd-8134-376bdf13b8cb service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received event network-vif-unplugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3f6c232b-0c96-4f9e-beec-7a1bae49c921 req-6077a93c-0596-41fd-8134-376bdf13b8cb service nova] Acquiring lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3f6c232b-0c96-4f9e-beec-7a1bae49c921 req-6077a93c-0596-41fd-8134-376bdf13b8cb service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3f6c232b-0c96-4f9e-beec-7a1bae49c921 req-6077a93c-0596-41fd-8134-376bdf13b8cb service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-3f6c232b-0c96-4f9e-beec-7a1bae49c921 req-6077a93c-0596-41fd-8134-376bdf13b8cb service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] No waiting events found dispatching network-vif-unplugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-3f6c232b-0c96-4f9e-beec-7a1bae49c921 req-6077a93c-0596-41fd-8134-376bdf13b8cb service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received event network-vif-unplugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:12 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Instance destroyed successfully.
Apr 11 22:02:12 user nova-compute[71364]: DEBUG nova.objects.instance [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'resources' on Instance uuid cc39cc0e-7829-408b-8477-0c57d8bfa2c5 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:02:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:56:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-595669330',display_name='tempest-AttachVolumeNegativeTest-server-595669330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-595669330',id=20,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz6mVMcT7TPTvnXw3zpX6cwXXyxar3QiaeczH68jSUuYR+MPNxtKZQvzYhSjWr+4ocLH7glsVk11JQLeOTc0UEw0OqaKeyfGTa6OCbXNYfa7N0mGhKuFFLIvEsAOe8gtw==',key_name='tempest-keypair-861149349',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:56:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='722a2704f607415ebe42af5ad98bf419',ramdisk_id='',reservation_id='r-w500xaei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2131251711',owner_user_name='tempest-AttachVolumeNegativeTest-2131251711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:56:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d615e85afb4354b37e88b5a24429d8',uuid=cc39cc0e-7829-408b-8477-0c57d8bfa2c5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "address": "fa:16:3e:7d:db:0d", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d06f000-36", "ovs_interfaceid": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:02:12 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converting VIF {"id": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "address": "fa:16:3e:7d:db:0d", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d06f000-36", "ovs_interfaceid": "2d06f000-3612-4f47-8d55-fcd6a395edd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:02:12 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:db:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d06f000-3612-4f47-8d55-fcd6a395edd4,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d06f000-36') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:02:12 user nova-compute[71364]: DEBUG os_vif [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:db:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d06f000-3612-4f47-8d55-fcd6a395edd4,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d06f000-36') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:02:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d06f000-36, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:02:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:02:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:12 user nova-compute[71364]: INFO os_vif [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:db:0d,bridge_name='br-int',has_traffic_filtering=True,id=2d06f000-3612-4f47-8d55-fcd6a395edd4,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d06f000-36')
Apr 11 22:02:12 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Deleting instance files /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5_del
Apr 11 22:02:12 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Deletion of /opt/stack/data/nova/instances/cc39cc0e-7829-408b-8477-0c57d8bfa2c5_del complete
Apr 11 22:02:12 user nova-compute[71364]: INFO nova.compute.manager [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 11 22:02:12 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:02:12 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:02:12 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:02:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:02:13 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Took 1.06 seconds to deallocate network for instance.
Apr 11 22:02:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-ca6bf7ea-ad71-44d3-a465-ae33c74ec47a req-b44f65ed-475f-4e4a-980d-47f09331e514 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received event network-vif-deleted-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:13 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Deleted allocations for instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5
Apr 11 22:02:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received event network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Acquiring lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] No waiting events found dispatching network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:02:13 user nova-compute[71364]: WARNING nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received unexpected event network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance with vm_state deleted and task_state None.
Apr 11 22:02:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received event network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Acquiring lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] No waiting events found dispatching network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:02:13 user nova-compute[71364]: WARNING nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received unexpected event network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance with vm_state deleted and task_state None.
Apr 11 22:02:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received event network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Acquiring lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] No waiting events found dispatching network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:02:13 user nova-compute[71364]: WARNING nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received unexpected event network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance with vm_state deleted and task_state None.
Apr 11 22:02:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received event network-vif-unplugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Acquiring lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] No waiting events found dispatching network-vif-unplugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:02:13 user nova-compute[71364]: WARNING nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received unexpected event network-vif-unplugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance with vm_state deleted and task_state None.
Apr 11 22:02:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received event network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Acquiring lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] No waiting events found dispatching network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:02:13 user nova-compute[71364]: WARNING nova.compute.manager [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Received unexpected event network-vif-plugged-2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance with vm_state deleted and task_state None.
Apr 11 22:02:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "cc39cc0e-7829-408b-8477-0c57d8bfa2c5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.396s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:02:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:02:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:02:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:02:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:02:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:27 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250532.0209174, cc39cc0e-7829-408b-8477-0c57d8bfa2c5 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:02:27 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] VM Stopped (Lifecycle Event)
Apr 11 22:02:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3fd0651b-912f-4d33-b35d-24ba4c650bf2 None None] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:02:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-765bb3a4-cb69-4de8-8fd0-853c9a58af41 req-de72b078-8690-48fc-b30b-77bd85804daf service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Received event network-changed-660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-765bb3a4-cb69-4de8-8fd0-853c9a58af41 req-de72b078-8690-48fc-b30b-77bd85804daf service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Refreshing instance network info cache due to event network-changed-660ded54-a2aa-4862-91a0-1aa1948cb5a0. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-765bb3a4-cb69-4de8-8fd0-853c9a58af41 req-de72b078-8690-48fc-b30b-77bd85804daf service nova] Acquiring lock "refresh_cache-5366a438-0f96-4ae2-8c99-48f98501baa3" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-765bb3a4-cb69-4de8-8fd0-853c9a58af41 req-de72b078-8690-48fc-b30b-77bd85804daf service nova] Acquired lock "refresh_cache-5366a438-0f96-4ae2-8c99-48f98501baa3" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG nova.network.neutron [req-765bb3a4-cb69-4de8-8fd0-853c9a58af41 req-de72b078-8690-48fc-b30b-77bd85804daf service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Refreshing network info cache for port 660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG nova.objects.instance [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'flavor' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:29 user nova-compute[71364]: INFO nova.compute.manager [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Attaching volume 1a256a75-2ac6-4a47-a653-8ae00b61eb46 to /dev/vdb
Apr 11 22:02:29 user nova-compute[71364]: DEBUG os_brick.utils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[164d408e-6264-43fd-85a7-eb332ae6585b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d531c7c-ef2b-4efb-a1a1-1f16743c1c8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b4926a-3154-4d94-8761-9044b11db280]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce8c509-9723-4170-a1ed-1ce4aac85440]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG nova.network.neutron [req-765bb3a4-cb69-4de8-8fd0-853c9a58af41 req-de72b078-8690-48fc-b30b-77bd85804daf service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Updated VIF entry in instance network info cache for port 660ded54-a2aa-4862-91a0-1aa1948cb5a0. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG nova.network.neutron [req-765bb3a4-cb69-4de8-8fd0-853c9a58af41 req-de72b078-8690-48fc-b30b-77bd85804daf service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Updating instance_info_cache with network_info: [{"id": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "address": "fa:16:3e:49:5f:74", "network": {"id": "b465435f-c5f6-4407-a24c-2a48de8b4b28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28080865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99e47eb6cfb467a943499e4b6172d5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660ded54-a2", "ovs_interfaceid": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-765bb3a4-cb69-4de8-8fd0-853c9a58af41 req-de72b078-8690-48fc-b30b-77bd85804daf service nova] Releasing lock "refresh_cache-5366a438-0f96-4ae2-8c99-48f98501baa3" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:02:29 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:02:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02aa922-7f47-45a2-8a96-8363f9bd4872]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG os_brick.utils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:02:29 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Updating existing volume attachment record: 5d8b3c6e-7910-4230-9aee-47d11f02b738 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:02:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGwmbxdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:02:33 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:02:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:02:33 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:02:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:02:33 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f50fa-9e7f-4b25-9d9f-a2ed471826b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:02:33 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[168a078f-6194-4500-acc5-47416fd27d7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46] added
Apr 11 22:02:33 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ab0536-6daf-4ff0-b43f-cc1b808f72ec]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0205ede0-8ad4-43ac-b476-13c13a401242]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YGwmbxdp {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YGwmbxdp" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f398f12-e0eb-495a-8c99-e7d7de197633]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YGwmbxdp'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d562b860-2892-459a-96d4-daafb678ef02]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9461317-548e-4c01-b54c-3626b745585e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:02:34 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:02:34 user nova-compute[71364]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:02:34 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:02:34 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:02:34 user nova-compute[71364]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:02:34 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e426b-1f59-4bfc-af5c-15af962a73ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46, portal: 172.16.0.220,3260]
Apr 11 22:02:34 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46, portal: 172.16.0.220,3260] successful.
Apr 11 22:02:34 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff800c37-a666-45cc-924d-d325ea3fa9fb]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08220dc-4258-4875-a2a4-bd918968ac67]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:02:34 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:02:34 user nova-compute[71364]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:02:34 user nova-compute[71364]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 (non-flash)
Apr 11 22:02:34 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:02:34 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:02:34 user nova-compute[71364]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:02:34 user nova-compute[71364]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 (non-flash)
Apr 11 22:02:34 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ded096c-992d-418c-9ed3-a27ecf1820c1]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:02:34 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGwmbxdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:02:35 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:02:35 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23539643435373861', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:02:35 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539643435373861', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:02:35 user nova-compute[71364]: DEBUG nova.objects.instance [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'flavor' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:02:35 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 22:02:35 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:02:35 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:02:35 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:02:35 user nova-compute[71364]:   <serial>1a256a75-2ac6-4a47-a653-8ae00b61eb46</serial>
Apr 11 22:02:35 user nova-compute[71364]: </disk>
Apr 11 22:02:35 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 22:02:35 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:02:35 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:02:35 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] No VIF found with MAC fa:16:3e:49:5f:74, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:02:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.303s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:39 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:02:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:02:39 user nova-compute[71364]: INFO nova.compute.claims [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Claim successful on node user
Apr 11 22:02:39 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:02:39 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:02:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:39 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:02:40 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:02:40 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG nova.policy [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c88df8be325448df9b24d49c3a7f6504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1f96aca4e547ef93d0d811ab4a8840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:02:40 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Creating image(s)
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "/opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "/opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.159s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk 1073741824" returned: 0 in 0.048s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.142s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Successfully created port: b581b302-d2b3-4038-b1e3-7e0474ba6bec {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Cannot resize image /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lazy-loading 'migration_context' on Instance uuid b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Ensure instance console log exists: /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:41 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Successfully updated port: b581b302-d2b3-4038-b1e3-7e0474ba6bec {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:02:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "refresh_cache-b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:02:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquired lock "refresh_cache-b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:02:41 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:02:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-f164c28b-da59-4989-8cc6-d33073df6c65 req-c45dafbc-8810-44e0-b67d-96c0599c2002 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Received event network-changed-b581b302-d2b3-4038-b1e3-7e0474ba6bec {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:02:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-f164c28b-da59-4989-8cc6-d33073df6c65 req-c45dafbc-8810-44e0-b67d-96c0599c2002 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Refreshing instance network info cache due to event network-changed-b581b302-d2b3-4038-b1e3-7e0474ba6bec. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:02:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f164c28b-da59-4989-8cc6-d33073df6c65 req-c45dafbc-8810-44e0-b67d-96c0599c2002 service nova] Acquiring lock "refresh_cache-b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:02:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:41 user nova-compute[71364]: INFO nova.compute.manager [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Detaching volume 1a256a75-2ac6-4a47-a653-8ae00b61eb46
Apr 11 22:02:41 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:02:41 user nova-compute[71364]: INFO nova.virt.block_device [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Attempting to driver detach volume 1a256a75-2ac6-4a47-a653-8ae00b61eb46 from mountpoint /dev/vdb
Apr 11 22:02:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Attempting to detach device vdb from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:02:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:02:41 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:02:41 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:02:41 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:02:41 user nova-compute[71364]:   <serial>1a256a75-2ac6-4a47-a653-8ae00b61eb46</serial>
Apr 11 22:02:41 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:02:41 user nova-compute[71364]: </disk>
Apr 11 22:02:41 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:02:41 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Successfully detached device vdb from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the persistent domain config.
Apr 11 22:02:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:02:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:02:41 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:02:41 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:02:41 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:02:41 user nova-compute[71364]:   <serial>1a256a75-2ac6-4a47-a653-8ae00b61eb46</serial>
Apr 11 22:02:41 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:02:41 user nova-compute[71364]: </disk>
Apr 11 22:02:41 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681250562.2095153, 5366a438-0f96-4ae2-8c99-48f98501baa3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:02:42 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Successfully detached device vdb from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the live domain config.
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGwmbxdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:02:42 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d04936-ca1f-4e7f-ab6c-da2c334d54d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:02:42 user nova-compute[71364]: No targets found.
Apr 11 22:02:42 user nova-compute[71364]: iSNS:
Apr 11 22:02:42 user nova-compute[71364]: No targets found.
Apr 11 22:02:42 user nova-compute[71364]: STATIC:
Apr 11 22:02:42 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:02:42 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:02:42 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:02:42 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab
Apr 11 22:02:42 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:02:42 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:02:42 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46
Apr 11 22:02:42 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:02:42 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:02:42 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe
Apr 11 22:02:42 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:02:42 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:02:42 user nova-compute[71364]: FIRMWARE:
Apr 11 22:02:42 user nova-compute[71364]: No targets found.
Apr 11 22:02:42 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:02:42 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:02:42 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b98f22b-0745-4f74-937d-1c908f5d3c4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3718357-e011-4387-bffb-4525891913f4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:02:42 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:02:42 user nova-compute[71364]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:02:42 user nova-compute[71364]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 (non-flash)
Apr 11 22:02:42 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:02:42 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:02:42 user nova-compute[71364]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:02:42 user nova-compute[71364]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 (non-flash)
Apr 11 22:02:42 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4baced3eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Updating instance_info_cache with network_info: [{"id": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "address": "fa:16:3e:39:3c:ff", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb581b302-d2", "ovs_interfaceid": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8614fc-b8a2-4fac-a305-20ae7826b55d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Releasing lock "refresh_cache-b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Instance network_info: |[{"id": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "address": "fa:16:3e:39:3c:ff", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb581b302-d2", "ovs_interfaceid": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f164c28b-da59-4989-8cc6-d33073df6c65 req-c45dafbc-8810-44e0-b67d-96c0599c2002 service nova] Acquired lock "refresh_cache-b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.network.neutron [req-f164c28b-da59-4989-8cc6-d33073df6c65 req-c45dafbc-8810-44e0-b67d-96c0599c2002 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Refreshing network info cache for port b581b302-d2b3-4038-b1e3-7e0474ba6bec {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Start _get_guest_xml network_info=[{"id": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "address": "fa:16:3e:39:3c:ff", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb581b302-d2", "ovs_interfaceid": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d38f253-249b-4cc1-a26d-246e78650f74]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:42 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:02:42 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1033299063',display_name='tempest-VolumesActionsTest-instance-1033299063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1033299063',id=27,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf1f96aca4e547ef93d0d811ab4a8840',ramdisk_id='',reservation_id='r-1rftm06u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-214311813',owner_user_name='tempest-VolumesActionsTest-214311813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:02:40Z,user_data=None,user_id='c88df8be325448df9b24d49c3a7f6504',uuid=b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "address": "fa:16:3e:39:3c:ff", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb581b302-d2", "ovs_interfaceid": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Converting VIF {"id": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "address": "fa:16:3e:39:3c:ff", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb581b302-d2", "ovs_interfaceid": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:3c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b581b302-d2b3-4038-b1e3-7e0474ba6bec,network=Network(0c9b930b-ce00-4ef1-9c4f-057d0212e71d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb581b302-d2') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lazy-loading 'pci_devices' on Instance uuid b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c9f1bd-ce99-457e-99a4-94ed5d5af385]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:02:42 user nova-compute[71364]:   <uuid>b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a</uuid>
Apr 11 22:02:42 user nova-compute[71364]:   <name>instance-0000001b</name>
Apr 11 22:02:42 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:02:42 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:02:42 user nova-compute[71364]:   <metadata>
Apr 11 22:02:42 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:02:42 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:02:42 user nova-compute[71364]:       <nova:name>tempest-VolumesActionsTest-instance-1033299063</nova:name>
Apr 11 22:02:42 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:02:42</nova:creationTime>
Apr 11 22:02:42 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:02:42 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:02:42 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:02:42 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:02:42 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:02:42 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:02:42 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:02:42 user nova-compute[71364]:       <nova:owner>
Apr 11 22:02:42 user nova-compute[71364]:         <nova:user uuid="c88df8be325448df9b24d49c3a7f6504">tempest-VolumesActionsTest-214311813-project-member</nova:user>
Apr 11 22:02:42 user nova-compute[71364]:         <nova:project uuid="bf1f96aca4e547ef93d0d811ab4a8840">tempest-VolumesActionsTest-214311813</nova:project>
Apr 11 22:02:42 user nova-compute[71364]:       </nova:owner>
Apr 11 22:02:42 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:02:42 user nova-compute[71364]:       <nova:ports>
Apr 11 22:02:42 user nova-compute[71364]:         <nova:port uuid="b581b302-d2b3-4038-b1e3-7e0474ba6bec">
Apr 11 22:02:42 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.2" ipVersion="4"/>
Apr 11 22:02:42 user nova-compute[71364]:         </nova:port>
Apr 11 22:02:42 user nova-compute[71364]:       </nova:ports>
Apr 11 22:02:42 user nova-compute[71364]:     </nova:instance>
Apr 11 22:02:42 user nova-compute[71364]:   </metadata>
Apr 11 22:02:42 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:02:42 user nova-compute[71364]:     <system>
Apr 11 22:02:42 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:02:42 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:02:42 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:02:42 user nova-compute[71364]:       <entry name="serial">b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a</entry>
Apr 11 22:02:42 user nova-compute[71364]:       <entry name="uuid">b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a</entry>
Apr 11 22:02:42 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:02:42 user nova-compute[71364]:     </system>
Apr 11 22:02:42 user nova-compute[71364]:   </sysinfo>
Apr 11 22:02:42 user nova-compute[71364]:   <os>
Apr 11 22:02:42 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:02:42 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:02:42 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:02:42 user nova-compute[71364]:   </os>
Apr 11 22:02:42 user nova-compute[71364]:   <features>
Apr 11 22:02:42 user nova-compute[71364]:     <acpi/>
Apr 11 22:02:42 user nova-compute[71364]:     <apic/>
Apr 11 22:02:42 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:02:42 user nova-compute[71364]:   </features>
Apr 11 22:02:42 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:02:42 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:02:42 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:02:42 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:02:42 user nova-compute[71364]:   </clock>
Apr 11 22:02:42 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:02:42 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:02:42 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:02:42 user nova-compute[71364]:   </cpu>
Apr 11 22:02:42 user nova-compute[71364]:   <devices>
Apr 11 22:02:42 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:02:42 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:02:42 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk"/>
Apr 11 22:02:42 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:02:42 user nova-compute[71364]:     </disk>
Apr 11 22:02:42 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:02:42 user nova-compute[71364]:       <mac address="fa:16:3e:39:3c:ff"/>
Apr 11 22:02:42 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:02:42 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:02:42 user nova-compute[71364]:       <target dev="tapb581b302-d2"/>
Apr 11 22:02:42 user nova-compute[71364]:     </interface>
Apr 11 22:02:42 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:02:42 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/console.log" append="off"/>
Apr 11 22:02:42 user nova-compute[71364]:     </serial>
Apr 11 22:02:42 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:02:42 user nova-compute[71364]:     <video>
Apr 11 22:02:42 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:02:42 user nova-compute[71364]:     </video>
Apr 11 22:02:42 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:02:42 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:02:42 user nova-compute[71364]:     </rng>
Apr 11 22:02:42 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:02:42 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:02:42 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:02:42 user nova-compute[71364]:     </memballoon>
Apr 11 22:02:42 user nova-compute[71364]:   </devices>
Apr 11 22:02:42 user nova-compute[71364]: </domain>
Apr 11 22:02:42 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1033299063',display_name='tempest-VolumesActionsTest-instance-1033299063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1033299063',id=27,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf1f96aca4e547ef93d0d811ab4a8840',ramdisk_id='',reservation_id='r-1rftm06u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-214311813',owner_user_name='tempest-VolumesActionsTest-214311813-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:02:40Z,user_data=None,user_id='c88df8be325448df9b24d49c3a7f6504',uuid=b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "address": "fa:16:3e:39:3c:ff", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb581b302-d2", "ovs_interfaceid": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Converting VIF {"id": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "address": "fa:16:3e:39:3c:ff", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb581b302-d2", "ovs_interfaceid": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:3c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b581b302-d2b3-4038-b1e3-7e0474ba6bec,network=Network(0c9b930b-ce00-4ef1-9c4f-057d0212e71d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb581b302-d2') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_vif [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:3c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b581b302-d2b3-4038-b1e3-7e0474ba6bec,network=Network(0c9b930b-ce00-4ef1-9c4f-057d0212e71d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb581b302-d2') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb581b302-d2, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb581b302-d2, col_values=(('external_ids', {'iface-id': 'b581b302-d2b3-4038-b1e3-7e0474ba6bec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:3c:ff', 'vm-uuid': 'b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:42 user nova-compute[71364]: INFO os_vif [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:3c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b581b302-d2b3-4038-b1e3-7e0474ba6bec,network=Network(0c9b930b-ce00-4ef1-9c4f-057d0212e71d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb581b302-d2')
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5554f6-e7c1-44fc-a541-3d3d366430d9]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91c0dd7-9c2b-43b6-82d2-861bd6a57a6e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] No VIF found with MAC fa:16:3e:39:3c:ff, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7783ae2e-a24b-4599-a9cd-d5d00c4253fc]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46, portal: 172.16.0.220,3260]
Apr 11 22:02:42 user nova-compute[71364]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46, portal: 172.16.0.220,3260] successful.
Apr 11 22:02:42 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a256a75-2ac6-4a47-a653-8ae00b61eb46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5773f9-c225-4a22-b77d-9ce99ee0c79a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] <== disconnect_volume: return (357ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.network.neutron [req-f164c28b-da59-4989-8cc6-d33073df6c65 req-c45dafbc-8810-44e0-b67d-96c0599c2002 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Updated VIF entry in instance network info cache for port b581b302-d2b3-4038-b1e3-7e0474ba6bec. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG nova.network.neutron [req-f164c28b-da59-4989-8cc6-d33073df6c65 req-c45dafbc-8810-44e0-b67d-96c0599c2002 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Updating instance_info_cache with network_info: [{"id": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "address": "fa:16:3e:39:3c:ff", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb581b302-d2", "ovs_interfaceid": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:02:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f164c28b-da59-4989-8cc6-d33073df6c65 req-c45dafbc-8810-44e0-b67d-96c0599c2002 service nova] Releasing lock "refresh_cache-b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:02:43 user nova-compute[71364]: DEBUG nova.objects.instance [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'flavor' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:02:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.697s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-13df2c45-7914-413d-9831-e845c4bc8efc req-1c09d141-50f3-4861-81cb-bf8320833a24 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Received event network-vif-plugged-b581b302-d2b3-4038-b1e3-7e0474ba6bec {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-13df2c45-7914-413d-9831-e845c4bc8efc req-1c09d141-50f3-4861-81cb-bf8320833a24 service nova] Acquiring lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-13df2c45-7914-413d-9831-e845c4bc8efc req-1c09d141-50f3-4861-81cb-bf8320833a24 service nova] Lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-13df2c45-7914-413d-9831-e845c4bc8efc req-1c09d141-50f3-4861-81cb-bf8320833a24 service nova] Lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-13df2c45-7914-413d-9831-e845c4bc8efc req-1c09d141-50f3-4861-81cb-bf8320833a24 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] No waiting events found dispatching network-vif-plugged-b581b302-d2b3-4038-b1e3-7e0474ba6bec {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:02:44 user nova-compute[71364]: WARNING nova.compute.manager [req-13df2c45-7914-413d-9831-e845c4bc8efc req-1c09d141-50f3-4861-81cb-bf8320833a24 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Received unexpected event network-vif-plugged-b581b302-d2b3-4038-b1e3-7e0474ba6bec for instance with vm_state building and task_state spawning.
Apr 11 22:02:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "d6268190-2187-4596-9f0b-026c520e5c67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "d6268190-2187-4596-9f0b-026c520e5c67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:02:44 user nova-compute[71364]: INFO nova.compute.claims [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Claim successful on node user
Apr 11 22:02:44 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:02:44 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:02:44 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:02:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.policy [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:02:45 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Creating image(s)
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "/opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "/opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk 1073741824" returned: 0 in 0.049s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Successfully created port: 44ef8405-caf6-4408-985a-654d964ae175 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Cannot resize image /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'migration_context' on Instance uuid d6268190-2187-4596-9f0b-026c520e5c67 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Ensure instance console log exists: /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250565.8916454, b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:02:45 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] VM Resumed (Lifecycle Event)
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:02:45 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Instance spawned successfully.
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:02:45 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250565.8948238, b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:02:45 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] VM Started (Lifecycle Event)
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:02:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:02:46 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:02:46 user nova-compute[71364]: INFO nova.compute.manager [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Took 5.82 seconds to spawn the instance on the hypervisor.
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.compute.manager [req-e74be371-9e16-451f-a619-819d59096950 req-a91cfef6-428c-4ff0-9c16-6797a69b0bd1 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Received event network-vif-plugged-b581b302-d2b3-4038-b1e3-7e0474ba6bec {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e74be371-9e16-451f-a619-819d59096950 req-a91cfef6-428c-4ff0-9c16-6797a69b0bd1 service nova] Acquiring lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e74be371-9e16-451f-a619-819d59096950 req-a91cfef6-428c-4ff0-9c16-6797a69b0bd1 service nova] Lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e74be371-9e16-451f-a619-819d59096950 req-a91cfef6-428c-4ff0-9c16-6797a69b0bd1 service nova] Lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.compute.manager [req-e74be371-9e16-451f-a619-819d59096950 req-a91cfef6-428c-4ff0-9c16-6797a69b0bd1 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] No waiting events found dispatching network-vif-plugged-b581b302-d2b3-4038-b1e3-7e0474ba6bec {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:02:46 user nova-compute[71364]: WARNING nova.compute.manager [req-e74be371-9e16-451f-a619-819d59096950 req-a91cfef6-428c-4ff0-9c16-6797a69b0bd1 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Received unexpected event network-vif-plugged-b581b302-d2b3-4038-b1e3-7e0474ba6bec for instance with vm_state building and task_state spawning.
Apr 11 22:02:46 user nova-compute[71364]: INFO nova.compute.manager [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Took 6.52 seconds to build instance.
Apr 11 22:02:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.607s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Successfully updated port: 44ef8405-caf6-4408-985a-654d964ae175 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "refresh_cache-d6268190-2187-4596-9f0b-026c520e5c67" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquired lock "refresh_cache-d6268190-2187-4596-9f0b-026c520e5c67" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.compute.manager [req-7f2e1854-798b-4416-9f53-e0fba0839256 req-d9bcd3b5-ce85-4a6e-aedb-8aa771b135f9 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Received event network-changed-44ef8405-caf6-4408-985a-654d964ae175 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.compute.manager [req-7f2e1854-798b-4416-9f53-e0fba0839256 req-d9bcd3b5-ce85-4a6e-aedb-8aa771b135f9 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Refreshing instance network info cache due to event network-changed-44ef8405-caf6-4408-985a-654d964ae175. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7f2e1854-798b-4416-9f53-e0fba0839256 req-d9bcd3b5-ce85-4a6e-aedb-8aa771b135f9 service nova] Acquiring lock "refresh_cache-d6268190-2187-4596-9f0b-026c520e5c67" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Updating instance_info_cache with network_info: [{"id": "44ef8405-caf6-4408-985a-654d964ae175", "address": "fa:16:3e:0d:e3:24", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44ef8405-ca", "ovs_interfaceid": "44ef8405-caf6-4408-985a-654d964ae175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Releasing lock "refresh_cache-d6268190-2187-4596-9f0b-026c520e5c67" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Instance network_info: |[{"id": "44ef8405-caf6-4408-985a-654d964ae175", "address": "fa:16:3e:0d:e3:24", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44ef8405-ca", "ovs_interfaceid": "44ef8405-caf6-4408-985a-654d964ae175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7f2e1854-798b-4416-9f53-e0fba0839256 req-d9bcd3b5-ce85-4a6e-aedb-8aa771b135f9 service nova] Acquired lock "refresh_cache-d6268190-2187-4596-9f0b-026c520e5c67" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.network.neutron [req-7f2e1854-798b-4416-9f53-e0fba0839256 req-d9bcd3b5-ce85-4a6e-aedb-8aa771b135f9 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Refreshing network info cache for port 44ef8405-caf6-4408-985a-654d964ae175 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Start _get_guest_xml network_info=[{"id": "44ef8405-caf6-4408-985a-654d964ae175", "address": "fa:16:3e:0d:e3:24", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44ef8405-ca", "ovs_interfaceid": "44ef8405-caf6-4408-985a-654d964ae175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:02:46 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:02:46 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1363289369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1363289369',id=28,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53057a8fc17e400e8c26a7dec2c873f9',ramdisk_id='',reservation_id='r-3ltev9nc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:02:45Z,user_data=None,user_id='10430313a8b44e6794ca88d30a83c69a',uuid=d6268190-2187-4596-9f0b-026c520e5c67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44ef8405-caf6-4408-985a-654d964ae175", "address": "fa:16:3e:0d:e3:24", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44ef8405-ca", "ovs_interfaceid": "44ef8405-caf6-4408-985a-654d964ae175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converting VIF {"id": "44ef8405-caf6-4408-985a-654d964ae175", "address": "fa:16:3e:0d:e3:24", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44ef8405-ca", "ovs_interfaceid": "44ef8405-caf6-4408-985a-654d964ae175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e3:24,bridge_name='br-int',has_traffic_filtering=True,id=44ef8405-caf6-4408-985a-654d964ae175,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44ef8405-ca') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'pci_devices' on Instance uuid d6268190-2187-4596-9f0b-026c520e5c67 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:02:46 user nova-compute[71364]:   <uuid>d6268190-2187-4596-9f0b-026c520e5c67</uuid>
Apr 11 22:02:46 user nova-compute[71364]:   <name>instance-0000001c</name>
Apr 11 22:02:46 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:02:46 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:02:46 user nova-compute[71364]:   <metadata>
Apr 11 22:02:46 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:02:46 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:02:46 user nova-compute[71364]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1363289369</nova:name>
Apr 11 22:02:46 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:02:46</nova:creationTime>
Apr 11 22:02:46 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:02:46 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:02:46 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:02:46 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:02:46 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:02:46 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:02:46 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:02:46 user nova-compute[71364]:       <nova:owner>
Apr 11 22:02:46 user nova-compute[71364]:         <nova:user uuid="10430313a8b44e6794ca88d30a83c69a">tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member</nova:user>
Apr 11 22:02:46 user nova-compute[71364]:         <nova:project uuid="53057a8fc17e400e8c26a7dec2c873f9">tempest-ServerBootFromVolumeStableRescueTest-1235920472</nova:project>
Apr 11 22:02:46 user nova-compute[71364]:       </nova:owner>
Apr 11 22:02:46 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:02:46 user nova-compute[71364]:       <nova:ports>
Apr 11 22:02:46 user nova-compute[71364]:         <nova:port uuid="44ef8405-caf6-4408-985a-654d964ae175">
Apr 11 22:02:46 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 22:02:46 user nova-compute[71364]:         </nova:port>
Apr 11 22:02:46 user nova-compute[71364]:       </nova:ports>
Apr 11 22:02:46 user nova-compute[71364]:     </nova:instance>
Apr 11 22:02:46 user nova-compute[71364]:   </metadata>
Apr 11 22:02:46 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:02:46 user nova-compute[71364]:     <system>
Apr 11 22:02:46 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:02:46 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:02:46 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:02:46 user nova-compute[71364]:       <entry name="serial">d6268190-2187-4596-9f0b-026c520e5c67</entry>
Apr 11 22:02:46 user nova-compute[71364]:       <entry name="uuid">d6268190-2187-4596-9f0b-026c520e5c67</entry>
Apr 11 22:02:46 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:02:46 user nova-compute[71364]:     </system>
Apr 11 22:02:46 user nova-compute[71364]:   </sysinfo>
Apr 11 22:02:46 user nova-compute[71364]:   <os>
Apr 11 22:02:46 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:02:46 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:02:46 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:02:46 user nova-compute[71364]:   </os>
Apr 11 22:02:46 user nova-compute[71364]:   <features>
Apr 11 22:02:46 user nova-compute[71364]:     <acpi/>
Apr 11 22:02:46 user nova-compute[71364]:     <apic/>
Apr 11 22:02:46 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:02:46 user nova-compute[71364]:   </features>
Apr 11 22:02:46 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:02:46 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:02:46 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:02:46 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:02:46 user nova-compute[71364]:   </clock>
Apr 11 22:02:46 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:02:46 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:02:46 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:02:46 user nova-compute[71364]:   </cpu>
Apr 11 22:02:46 user nova-compute[71364]:   <devices>
Apr 11 22:02:46 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:02:46 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:02:46 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk"/>
Apr 11 22:02:46 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:02:46 user nova-compute[71364]:     </disk>
Apr 11 22:02:46 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:02:46 user nova-compute[71364]:       <mac address="fa:16:3e:0d:e3:24"/>
Apr 11 22:02:46 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:02:46 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:02:46 user nova-compute[71364]:       <target dev="tap44ef8405-ca"/>
Apr 11 22:02:46 user nova-compute[71364]:     </interface>
Apr 11 22:02:46 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:02:46 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/console.log" append="off"/>
Apr 11 22:02:46 user nova-compute[71364]:     </serial>
Apr 11 22:02:46 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:02:46 user nova-compute[71364]:     <video>
Apr 11 22:02:46 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:02:46 user nova-compute[71364]:     </video>
Apr 11 22:02:46 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:02:46 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:02:46 user nova-compute[71364]:     </rng>
Apr 11 22:02:46 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:02:46 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:02:46 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:02:46 user nova-compute[71364]:     </memballoon>
Apr 11 22:02:46 user nova-compute[71364]:   </devices>
Apr 11 22:02:46 user nova-compute[71364]: </domain>
Apr 11 22:02:46 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1363289369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1363289369',id=28,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53057a8fc17e400e8c26a7dec2c873f9',ramdisk_id='',reservation_id='r-3ltev9nc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:02:45Z,user_data=None,user_id='10430313a8b44e6794ca88d30a83c69a',uuid=d6268190-2187-4596-9f0b-026c520e5c67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44ef8405-caf6-4408-985a-654d964ae175", "address": "fa:16:3e:0d:e3:24", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44ef8405-ca", "ovs_interfaceid": "44ef8405-caf6-4408-985a-654d964ae175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converting VIF {"id": "44ef8405-caf6-4408-985a-654d964ae175", "address": "fa:16:3e:0d:e3:24", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44ef8405-ca", "ovs_interfaceid": "44ef8405-caf6-4408-985a-654d964ae175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e3:24,bridge_name='br-int',has_traffic_filtering=True,id=44ef8405-caf6-4408-985a-654d964ae175,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44ef8405-ca') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG os_vif [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e3:24,bridge_name='br-int',has_traffic_filtering=True,id=44ef8405-caf6-4408-985a-654d964ae175,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44ef8405-ca') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44ef8405-ca, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44ef8405-ca, col_values=(('external_ids', {'iface-id': '44ef8405-caf6-4408-985a-654d964ae175', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:e3:24', 'vm-uuid': 'd6268190-2187-4596-9f0b-026c520e5c67'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:46 user nova-compute[71364]: INFO os_vif [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e3:24,bridge_name='br-int',has_traffic_filtering=True,id=44ef8405-caf6-4408-985a-654d964ae175,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44ef8405-ca')
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:02:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] No VIF found with MAC fa:16:3e:0d:e3:24, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:02:47 user nova-compute[71364]: DEBUG nova.network.neutron [req-7f2e1854-798b-4416-9f53-e0fba0839256 req-d9bcd3b5-ce85-4a6e-aedb-8aa771b135f9 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Updated VIF entry in instance network info cache for port 44ef8405-caf6-4408-985a-654d964ae175. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:02:47 user nova-compute[71364]: DEBUG nova.network.neutron [req-7f2e1854-798b-4416-9f53-e0fba0839256 req-d9bcd3b5-ce85-4a6e-aedb-8aa771b135f9 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Updating instance_info_cache with network_info: [{"id": "44ef8405-caf6-4408-985a-654d964ae175", "address": "fa:16:3e:0d:e3:24", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44ef8405-ca", "ovs_interfaceid": "44ef8405-caf6-4408-985a-654d964ae175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:02:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7f2e1854-798b-4416-9f53-e0fba0839256 req-d9bcd3b5-ce85-4a6e-aedb-8aa771b135f9 service nova] Releasing lock "refresh_cache-d6268190-2187-4596-9f0b-026c520e5c67" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:02:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-a4e2e380-d262-4d57-9459-4ad267cb1d0a req-870d8d0d-73a6-4d1b-9f77-532f615084d7 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Received event network-vif-plugged-44ef8405-caf6-4408-985a-654d964ae175 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:02:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a4e2e380-d262-4d57-9459-4ad267cb1d0a req-870d8d0d-73a6-4d1b-9f77-532f615084d7 service nova] Acquiring lock "d6268190-2187-4596-9f0b-026c520e5c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a4e2e380-d262-4d57-9459-4ad267cb1d0a req-870d8d0d-73a6-4d1b-9f77-532f615084d7 service nova] Lock "d6268190-2187-4596-9f0b-026c520e5c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a4e2e380-d262-4d57-9459-4ad267cb1d0a req-870d8d0d-73a6-4d1b-9f77-532f615084d7 service nova] Lock "d6268190-2187-4596-9f0b-026c520e5c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-a4e2e380-d262-4d57-9459-4ad267cb1d0a req-870d8d0d-73a6-4d1b-9f77-532f615084d7 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] No waiting events found dispatching network-vif-plugged-44ef8405-caf6-4408-985a-654d964ae175 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:02:48 user nova-compute[71364]: WARNING nova.compute.manager [req-a4e2e380-d262-4d57-9459-4ad267cb1d0a req-870d8d0d-73a6-4d1b-9f77-532f615084d7 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Received unexpected event network-vif-plugged-44ef8405-caf6-4408-985a-654d964ae175 for instance with vm_state building and task_state spawning.
Apr 11 22:02:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250570.3605886, d6268190-2187-4596-9f0b-026c520e5c67 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:02:50 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6268190-2187-4596-9f0b-026c520e5c67] VM Resumed (Lifecycle Event)
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:02:50 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Instance spawned successfully.
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:02:50 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6268190-2187-4596-9f0b-026c520e5c67] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250570.3640149, d6268190-2187-4596-9f0b-026c520e5c67 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:02:50 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6268190-2187-4596-9f0b-026c520e5c67] VM Started (Lifecycle Event)
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:02:50 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6268190-2187-4596-9f0b-026c520e5c67] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-7996223a-8b8d-4135-9092-c56b09ea9b46 req-cd69a41b-b4ad-4b81-9862-12a079b022a0 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Received event network-vif-plugged-44ef8405-caf6-4408-985a-654d964ae175 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7996223a-8b8d-4135-9092-c56b09ea9b46 req-cd69a41b-b4ad-4b81-9862-12a079b022a0 service nova] Acquiring lock "d6268190-2187-4596-9f0b-026c520e5c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7996223a-8b8d-4135-9092-c56b09ea9b46 req-cd69a41b-b4ad-4b81-9862-12a079b022a0 service nova] Lock "d6268190-2187-4596-9f0b-026c520e5c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7996223a-8b8d-4135-9092-c56b09ea9b46 req-cd69a41b-b4ad-4b81-9862-12a079b022a0 service nova] Lock "d6268190-2187-4596-9f0b-026c520e5c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-7996223a-8b8d-4135-9092-c56b09ea9b46 req-cd69a41b-b4ad-4b81-9862-12a079b022a0 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] No waiting events found dispatching network-vif-plugged-44ef8405-caf6-4408-985a-654d964ae175 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:02:50 user nova-compute[71364]: WARNING nova.compute.manager [req-7996223a-8b8d-4135-9092-c56b09ea9b46 req-cd69a41b-b4ad-4b81-9862-12a079b022a0 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Received unexpected event network-vif-plugged-44ef8405-caf6-4408-985a-654d964ae175 for instance with vm_state building and task_state spawning.
Apr 11 22:02:50 user nova-compute[71364]: INFO nova.compute.manager [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Took 5.45 seconds to spawn the instance on the hypervisor.
Apr 11 22:02:50 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:02:50 user nova-compute[71364]: INFO nova.compute.manager [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Took 6.13 seconds to build instance.
Apr 11 22:02:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "d6268190-2187-4596-9f0b-026c520e5c67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.223s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:56 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:02:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:02:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:02:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:02:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:02:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:58 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:02:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:02:59 user nova-compute[71364]: INFO nova.compute.manager [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Detaching volume 594600b9-5a65-44f7-9a8c-c741f0ef19fe
Apr 11 22:02:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:02:59 user nova-compute[71364]: INFO nova.virt.block_device [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Attempting to driver detach volume 594600b9-5a65-44f7-9a8c-c741f0ef19fe from mountpoint /dev/vdb
Apr 11 22:02:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Attempting to detach device vdb from instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:02:59 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:02:59 user nova-compute[71364]:   <source dev="/dev/sde"/>
Apr 11 22:02:59 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:02:59 user nova-compute[71364]:   <serial>594600b9-5a65-44f7-9a8c-c741f0ef19fe</serial>
Apr 11 22:02:59 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 22:02:59 user nova-compute[71364]: </disk>
Apr 11 22:02:59 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:02:59 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Successfully detached device vdb from instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea from the persistent domain config.
Apr 11 22:02:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:02:59 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:02:59 user nova-compute[71364]:   <source dev="/dev/sde"/>
Apr 11 22:02:59 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:02:59 user nova-compute[71364]:   <serial>594600b9-5a65-44f7-9a8c-c741f0ef19fe</serial>
Apr 11 22:02:59 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 22:02:59 user nova-compute[71364]: </disk>
Apr 11 22:02:59 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:02:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681250580.282197, 53530e4f-a899-496d-8b83-a3b5f7dbc7ea => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:03:00 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Successfully detached device vdb from instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea from the live domain config.
Apr 11 22:03:00 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:03:00 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7899MB free_disk=26.18459701538086GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMYJtIcb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:03:00 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ae8025-92e5-40bc-8ed5-ec73d15a1f9f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:03:00 user nova-compute[71364]: No targets found.
Apr 11 22:03:00 user nova-compute[71364]: iSNS:
Apr 11 22:03:00 user nova-compute[71364]: No targets found.
Apr 11 22:03:00 user nova-compute[71364]: STATIC:
Apr 11 22:03:00 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:03:00 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:03:00 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:03:00 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab
Apr 11 22:03:00 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:03:00 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:03:00 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe
Apr 11 22:03:00 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:03:00 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:03:00 user nova-compute[71364]: FIRMWARE:
Apr 11 22:03:00 user nova-compute[71364]: No targets found.
Apr 11 22:03:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:03:00 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:03:00 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9bdf0b-8c6e-458a-9330-0c739214943c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2669e1-d50b-4be7-90a8-eb04a7a62b09]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:03:00 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:03:00 user nova-compute[71364]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:03:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:03:00 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:03:00 user nova-compute[71364]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe (non-flash)
Apr 11 22:03:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bf00e9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe'): ({'sde'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Removing single pathed devices sde {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f5d26a-43c9-4387-83e6-369a69d85eca]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9167e26-afa7-4fda-a913-4b1d8c7f63f5]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flushing IO for device /dev/sde {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5366a438-0f96-4ae2-8c99-48f98501baa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d6268190-2187-4596-9f0b-026c520e5c67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8b337e-e631-447d-b084-d299486ac8f0]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fd7ad1-740c-4091-918c-76f7c91122cb]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d2b132-d26f-49b8-be60-31519da9ccdf]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3d88ec-6610-467f-9d89-8c7374915a94]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260]
Apr 11 22:03:00 user nova-compute[71364]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe, portal: 172.16.0.220,3260] successful.
Apr 11 22:03:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:594600b9-5a65-44f7-9a8c-c741f0ef19fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2b56f9-21cb-472b-9210-eb099429763f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] <== disconnect_volume: return (334ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:03:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:01 user nova-compute[71364]: DEBUG nova.objects.instance [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'flavor' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:03:01 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:03:01 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:03:01 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 22:03:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.318s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:03:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:03:02 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:03:02 user nova-compute[71364]: DEBUG nova.objects.instance [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lazy-loading 'info_cache' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:03:02 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating instance_info_cache with network_info: [{"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:03:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-5ff9bbaf-1a5e-4acd-aca3-d956728312cb" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:03:02 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:03:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:03:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:03:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:03:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:03:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:03:02 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-58a19b61-da24-4c4f-8984-344480f31013 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-58a19b61-da24-4c4f-8984-344480f31013 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-58a19b61-da24-4c4f-8984-344480f31013 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-58a19b61-da24-4c4f-8984-344480f31013 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71364) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG nova.objects.instance [None req-58a19b61-da24-4c4f-8984-344480f31013 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'flavor' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-e4fa19cb-a588-456d-974e-a9e8c3060db8 req-97848b72-e465-42c3-aa5e-238bacd17ade service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e4fa19cb-a588-456d-974e-a9e8c3060db8 req-97848b72-e465-42c3-aa5e-238bacd17ade service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e4fa19cb-a588-456d-974e-a9e8c3060db8 req-97848b72-e465-42c3-aa5e-238bacd17ade service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e4fa19cb-a588-456d-974e-a9e8c3060db8 req-97848b72-e465-42c3-aa5e-238bacd17ade service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-e4fa19cb-a588-456d-974e-a9e8c3060db8 req-97848b72-e465-42c3-aa5e-238bacd17ade service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:03:03 user nova-compute[71364]: WARNING nova.compute.manager [req-e4fa19cb-a588-456d-974e-a9e8c3060db8 req-97848b72-e465-42c3-aa5e-238bacd17ade service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state active and task_state powering-off.
Apr 11 22:03:03 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Instance destroyed successfully.
Apr 11 22:03:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-58a19b61-da24-4c4f-8984-344480f31013 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:03:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-58a19b61-da24-4c4f-8984-344480f31013 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.849s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:04 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:03:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:03:05 user nova-compute[71364]: INFO nova.compute.claims [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Claim successful on node user
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.173s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:03:05 user nova-compute[71364]: INFO nova.compute.claims [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Claim successful on node user
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-7c59b18f-1502-4641-aab7-1d95939f8a83 req-15c71efd-1d16-498a-9137-b7ca097a3a59 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7c59b18f-1502-4641-aab7-1d95939f8a83 req-15c71efd-1d16-498a-9137-b7ca097a3a59 service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7c59b18f-1502-4641-aab7-1d95939f8a83 req-15c71efd-1d16-498a-9137-b7ca097a3a59 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7c59b18f-1502-4641-aab7-1d95939f8a83 req-15c71efd-1d16-498a-9137-b7ca097a3a59 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-7c59b18f-1502-4641-aab7-1d95939f8a83 req-15c71efd-1d16-498a-9137-b7ca097a3a59 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:03:05 user nova-compute[71364]: WARNING nova.compute.manager [req-7c59b18f-1502-4641-aab7-1d95939f8a83 req-15c71efd-1d16-498a-9137-b7ca097a3a59 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state stopped and task_state None.
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.network.neutron [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:03:05 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.policy [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:03:05 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Creating image(s)
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "/opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "/opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "/opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk 1073741824" returned: 0 in 0.054s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.policy [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Cannot resize image /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.objects.instance [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'migration_context' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Ensure instance console log exists: /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.network.neutron [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Successfully created port: 3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:03:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Creating image(s)
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "/opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "/opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.128s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.126s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk 1073741824" returned: 0 in 0.044s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.177s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Successfully created port: dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Cannot resize image /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'migration_context' on Instance uuid e3cabf27-6d08-41f3-9f09-fa11b614f1d0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Ensure instance console log exists: /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.network.neutron [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Successfully updated port: 3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquired lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.network.neutron [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.network.neutron [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-9f465cf3-087a-4c3e-97b9-6cabdd368acc req-8031ec06-c981-404f-b874-5360fa4babb3 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-changed-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-9f465cf3-087a-4c3e-97b9-6cabdd368acc req-8031ec06-c981-404f-b874-5360fa4babb3 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Refreshing instance network info cache due to event network-changed-3b90af5a-ae8d-4876-bda9-002751948bb0. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9f465cf3-087a-4c3e-97b9-6cabdd368acc req-8031ec06-c981-404f-b874-5360fa4babb3 service nova] Acquiring lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Successfully updated port: dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "refresh_cache-e3cabf27-6d08-41f3-9f09-fa11b614f1d0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquired lock "refresh_cache-e3cabf27-6d08-41f3-9f09-fa11b614f1d0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-5888396a-cd96-4ce5-8541-b75ea87ce24e req-df54d2ae-286d-4a70-8d4e-71f40ee56b43 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Received event network-changed-dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-5888396a-cd96-4ce5-8541-b75ea87ce24e req-df54d2ae-286d-4a70-8d4e-71f40ee56b43 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Refreshing instance network info cache due to event network-changed-dfc2024c-6b00-43d9-99e4-701ec0227c59. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5888396a-cd96-4ce5-8541-b75ea87ce24e req-df54d2ae-286d-4a70-8d4e-71f40ee56b43 service nova] Acquiring lock "refresh_cache-e3cabf27-6d08-41f3-9f09-fa11b614f1d0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.network.neutron [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Updating instance_info_cache with network_info: [{"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Releasing lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Instance network_info: |[{"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9f465cf3-087a-4c3e-97b9-6cabdd368acc req-8031ec06-c981-404f-b874-5360fa4babb3 service nova] Acquired lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.network.neutron [req-9f465cf3-087a-4c3e-97b9-6cabdd368acc req-8031ec06-c981-404f-b874-5360fa4babb3 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Refreshing network info cache for port 3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Start _get_guest_xml network_info=[{"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:03:07 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:03:07 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1950121008',display_name='tempest-ServerRescueNegativeTestJSON-server-1950121008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1950121008',id=29,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1rI3/ko2FizEbaKBgYZ6vNc2Qja+cKtbUN+7VeXaafSg+Iq4uwb7LY1gcxR2uaqZyccMuV4smpseEyWhf4dx7LAxvozpzLvmsuld7AJptCsX+pJs1Gi+3Tk2oYbYYwHA==',key_name='tempest-keypair-337352633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c35707743988462887127e06825cd483',ramdisk_id='',reservation_id='r-9ala1i8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-797099247',owner_user_name='tempest-ServerRescueNegativeTestJSON-797099247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='546f0a94a2ad450ead596252c786839e',uuid=b485c9c2-8fb4-4690-af26-ddfae00d5024,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converting VIF {"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:4c:82,bridge_name='br-int',has_traffic_filtering=True,id=3b90af5a-ae8d-4876-bda9-002751948bb0,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b90af5a-ae') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.objects.instance [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'pci_devices' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:03:07 user nova-compute[71364]:   <uuid>b485c9c2-8fb4-4690-af26-ddfae00d5024</uuid>
Apr 11 22:03:07 user nova-compute[71364]:   <name>instance-0000001d</name>
Apr 11 22:03:07 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:03:07 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:03:07 user nova-compute[71364]:   <metadata>
Apr 11 22:03:07 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:03:07 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:03:07 user nova-compute[71364]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1950121008</nova:name>
Apr 11 22:03:07 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:03:07</nova:creationTime>
Apr 11 22:03:07 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:03:07 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:03:07 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:03:07 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:03:07 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:03:07 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:03:07 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:03:07 user nova-compute[71364]:       <nova:owner>
Apr 11 22:03:07 user nova-compute[71364]:         <nova:user uuid="546f0a94a2ad450ead596252c786839e">tempest-ServerRescueNegativeTestJSON-797099247-project-member</nova:user>
Apr 11 22:03:07 user nova-compute[71364]:         <nova:project uuid="c35707743988462887127e06825cd483">tempest-ServerRescueNegativeTestJSON-797099247</nova:project>
Apr 11 22:03:07 user nova-compute[71364]:       </nova:owner>
Apr 11 22:03:07 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:03:07 user nova-compute[71364]:       <nova:ports>
Apr 11 22:03:07 user nova-compute[71364]:         <nova:port uuid="3b90af5a-ae8d-4876-bda9-002751948bb0">
Apr 11 22:03:07 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 22:03:07 user nova-compute[71364]:         </nova:port>
Apr 11 22:03:07 user nova-compute[71364]:       </nova:ports>
Apr 11 22:03:07 user nova-compute[71364]:     </nova:instance>
Apr 11 22:03:07 user nova-compute[71364]:   </metadata>
Apr 11 22:03:07 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:03:07 user nova-compute[71364]:     <system>
Apr 11 22:03:07 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:03:07 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:03:07 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:03:07 user nova-compute[71364]:       <entry name="serial">b485c9c2-8fb4-4690-af26-ddfae00d5024</entry>
Apr 11 22:03:07 user nova-compute[71364]:       <entry name="uuid">b485c9c2-8fb4-4690-af26-ddfae00d5024</entry>
Apr 11 22:03:07 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:03:07 user nova-compute[71364]:     </system>
Apr 11 22:03:07 user nova-compute[71364]:   </sysinfo>
Apr 11 22:03:07 user nova-compute[71364]:   <os>
Apr 11 22:03:07 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:03:07 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:03:07 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:03:07 user nova-compute[71364]:   </os>
Apr 11 22:03:07 user nova-compute[71364]:   <features>
Apr 11 22:03:07 user nova-compute[71364]:     <acpi/>
Apr 11 22:03:07 user nova-compute[71364]:     <apic/>
Apr 11 22:03:07 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:03:07 user nova-compute[71364]:   </features>
Apr 11 22:03:07 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:03:07 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:03:07 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:03:07 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:03:07 user nova-compute[71364]:   </clock>
Apr 11 22:03:07 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:03:07 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:03:07 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:03:07 user nova-compute[71364]:   </cpu>
Apr 11 22:03:07 user nova-compute[71364]:   <devices>
Apr 11 22:03:07 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:03:07 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:03:07 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk"/>
Apr 11 22:03:07 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:03:07 user nova-compute[71364]:     </disk>
Apr 11 22:03:07 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:03:07 user nova-compute[71364]:       <mac address="fa:16:3e:38:4c:82"/>
Apr 11 22:03:07 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:03:07 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:03:07 user nova-compute[71364]:       <target dev="tap3b90af5a-ae"/>
Apr 11 22:03:07 user nova-compute[71364]:     </interface>
Apr 11 22:03:07 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:03:07 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/console.log" append="off"/>
Apr 11 22:03:07 user nova-compute[71364]:     </serial>
Apr 11 22:03:07 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:03:07 user nova-compute[71364]:     <video>
Apr 11 22:03:07 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:03:07 user nova-compute[71364]:     </video>
Apr 11 22:03:07 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:03:07 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:03:07 user nova-compute[71364]:     </rng>
Apr 11 22:03:07 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:03:07 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:03:07 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:03:07 user nova-compute[71364]:     </memballoon>
Apr 11 22:03:07 user nova-compute[71364]:   </devices>
Apr 11 22:03:07 user nova-compute[71364]: </domain>
Apr 11 22:03:07 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1950121008',display_name='tempest-ServerRescueNegativeTestJSON-server-1950121008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1950121008',id=29,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1rI3/ko2FizEbaKBgYZ6vNc2Qja+cKtbUN+7VeXaafSg+Iq4uwb7LY1gcxR2uaqZyccMuV4smpseEyWhf4dx7LAxvozpzLvmsuld7AJptCsX+pJs1Gi+3Tk2oYbYYwHA==',key_name='tempest-keypair-337352633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c35707743988462887127e06825cd483',ramdisk_id='',reservation_id='r-9ala1i8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-797099247',owner_user_name='tempest-ServerRescueNegativeTestJSON-797099247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='546f0a94a2ad450ead596252c786839e',uuid=b485c9c2-8fb4-4690-af26-ddfae00d5024,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converting VIF {"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:4c:82,bridge_name='br-int',has_traffic_filtering=True,id=3b90af5a-ae8d-4876-bda9-002751948bb0,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b90af5a-ae') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG os_vif [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:4c:82,bridge_name='br-int',has_traffic_filtering=True,id=3b90af5a-ae8d-4876-bda9-002751948bb0,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b90af5a-ae') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b90af5a-ae, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b90af5a-ae, col_values=(('external_ids', {'iface-id': '3b90af5a-ae8d-4876-bda9-002751948bb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:4c:82', 'vm-uuid': 'b485c9c2-8fb4-4690-af26-ddfae00d5024'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:07 user nova-compute[71364]: INFO os_vif [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:4c:82,bridge_name='br-int',has_traffic_filtering=True,id=3b90af5a-ae8d-4876-bda9-002751948bb0,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b90af5a-ae')
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No VIF found with MAC fa:16:3e:38:4c:82, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:03:07 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Updating instance_info_cache with network_info: [{"id": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "address": "fa:16:3e:df:cc:37", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc2024c-6b", "ovs_interfaceid": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Releasing lock "refresh_cache-e3cabf27-6d08-41f3-9f09-fa11b614f1d0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Instance network_info: |[{"id": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "address": "fa:16:3e:df:cc:37", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc2024c-6b", "ovs_interfaceid": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5888396a-cd96-4ce5-8541-b75ea87ce24e req-df54d2ae-286d-4a70-8d4e-71f40ee56b43 service nova] Acquired lock "refresh_cache-e3cabf27-6d08-41f3-9f09-fa11b614f1d0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.network.neutron [req-5888396a-cd96-4ce5-8541-b75ea87ce24e req-df54d2ae-286d-4a70-8d4e-71f40ee56b43 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Refreshing network info cache for port dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Start _get_guest_xml network_info=[{"id": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "address": "fa:16:3e:df:cc:37", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc2024c-6b", "ovs_interfaceid": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:03:08 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:03:08 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1426237921',display_name='tempest-AttachVolumeNegativeTest-server-1426237921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1426237921',id=30,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRr4IWLq3T4jHMGPjljW6TmNMH2L69htysqM9Sz2e4uBsfapdGC98UY1R7j8JhRkX/MjbG3HhmM33uG3A5dPhqhyUBaVRQZVg7cZUGNKeEmiqTcFWT48IoKEQKcXarNuA==',key_name='tempest-keypair-1416556452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='722a2704f607415ebe42af5ad98bf419',ramdisk_id='',reservation_id='r-npm26r2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2131251711',owner_user_name='tempest-AttachVolumeNegativeTest-2131251711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d615e85afb4354b37e88b5a24429d8',uuid=e3cabf27-6d08-41f3-9f09-fa11b614f1d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "address": "fa:16:3e:df:cc:37", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc2024c-6b", "ovs_interfaceid": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converting VIF {"id": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "address": "fa:16:3e:df:cc:37", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc2024c-6b", "ovs_interfaceid": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:cc:37,bridge_name='br-int',has_traffic_filtering=True,id=dfc2024c-6b00-43d9-99e4-701ec0227c59,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc2024c-6b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'pci_devices' on Instance uuid e3cabf27-6d08-41f3-9f09-fa11b614f1d0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:03:08 user nova-compute[71364]:   <uuid>e3cabf27-6d08-41f3-9f09-fa11b614f1d0</uuid>
Apr 11 22:03:08 user nova-compute[71364]:   <name>instance-0000001e</name>
Apr 11 22:03:08 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:03:08 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:03:08 user nova-compute[71364]:   <metadata>
Apr 11 22:03:08 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:03:08 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:03:08 user nova-compute[71364]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1426237921</nova:name>
Apr 11 22:03:08 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:03:08</nova:creationTime>
Apr 11 22:03:08 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:03:08 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:03:08 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:03:08 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:03:08 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:03:08 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:03:08 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:03:08 user nova-compute[71364]:       <nova:owner>
Apr 11 22:03:08 user nova-compute[71364]:         <nova:user uuid="b6d615e85afb4354b37e88b5a24429d8">tempest-AttachVolumeNegativeTest-2131251711-project-member</nova:user>
Apr 11 22:03:08 user nova-compute[71364]:         <nova:project uuid="722a2704f607415ebe42af5ad98bf419">tempest-AttachVolumeNegativeTest-2131251711</nova:project>
Apr 11 22:03:08 user nova-compute[71364]:       </nova:owner>
Apr 11 22:03:08 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:03:08 user nova-compute[71364]:       <nova:ports>
Apr 11 22:03:08 user nova-compute[71364]:         <nova:port uuid="dfc2024c-6b00-43d9-99e4-701ec0227c59">
Apr 11 22:03:08 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 22:03:08 user nova-compute[71364]:         </nova:port>
Apr 11 22:03:08 user nova-compute[71364]:       </nova:ports>
Apr 11 22:03:08 user nova-compute[71364]:     </nova:instance>
Apr 11 22:03:08 user nova-compute[71364]:   </metadata>
Apr 11 22:03:08 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:03:08 user nova-compute[71364]:     <system>
Apr 11 22:03:08 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:03:08 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:03:08 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:03:08 user nova-compute[71364]:       <entry name="serial">e3cabf27-6d08-41f3-9f09-fa11b614f1d0</entry>
Apr 11 22:03:08 user nova-compute[71364]:       <entry name="uuid">e3cabf27-6d08-41f3-9f09-fa11b614f1d0</entry>
Apr 11 22:03:08 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:03:08 user nova-compute[71364]:     </system>
Apr 11 22:03:08 user nova-compute[71364]:   </sysinfo>
Apr 11 22:03:08 user nova-compute[71364]:   <os>
Apr 11 22:03:08 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:03:08 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:03:08 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:03:08 user nova-compute[71364]:   </os>
Apr 11 22:03:08 user nova-compute[71364]:   <features>
Apr 11 22:03:08 user nova-compute[71364]:     <acpi/>
Apr 11 22:03:08 user nova-compute[71364]:     <apic/>
Apr 11 22:03:08 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:03:08 user nova-compute[71364]:   </features>
Apr 11 22:03:08 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:03:08 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:03:08 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:03:08 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:03:08 user nova-compute[71364]:   </clock>
Apr 11 22:03:08 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:03:08 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:03:08 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:03:08 user nova-compute[71364]:   </cpu>
Apr 11 22:03:08 user nova-compute[71364]:   <devices>
Apr 11 22:03:08 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:03:08 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:03:08 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk"/>
Apr 11 22:03:08 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:03:08 user nova-compute[71364]:     </disk>
Apr 11 22:03:08 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:03:08 user nova-compute[71364]:       <mac address="fa:16:3e:df:cc:37"/>
Apr 11 22:03:08 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:03:08 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:03:08 user nova-compute[71364]:       <target dev="tapdfc2024c-6b"/>
Apr 11 22:03:08 user nova-compute[71364]:     </interface>
Apr 11 22:03:08 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:03:08 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/console.log" append="off"/>
Apr 11 22:03:08 user nova-compute[71364]:     </serial>
Apr 11 22:03:08 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:03:08 user nova-compute[71364]:     <video>
Apr 11 22:03:08 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:03:08 user nova-compute[71364]:     </video>
Apr 11 22:03:08 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:03:08 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:03:08 user nova-compute[71364]:     </rng>
Apr 11 22:03:08 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:03:08 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:03:08 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:03:08 user nova-compute[71364]:     </memballoon>
Apr 11 22:03:08 user nova-compute[71364]:   </devices>
Apr 11 22:03:08 user nova-compute[71364]: </domain>
Apr 11 22:03:08 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1426237921',display_name='tempest-AttachVolumeNegativeTest-server-1426237921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1426237921',id=30,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRr4IWLq3T4jHMGPjljW6TmNMH2L69htysqM9Sz2e4uBsfapdGC98UY1R7j8JhRkX/MjbG3HhmM33uG3A5dPhqhyUBaVRQZVg7cZUGNKeEmiqTcFWT48IoKEQKcXarNuA==',key_name='tempest-keypair-1416556452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='722a2704f607415ebe42af5ad98bf419',ramdisk_id='',reservation_id='r-npm26r2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2131251711',owner_user_name='tempest-AttachVolumeNegativeTest-2131251711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d615e85afb4354b37e88b5a24429d8',uuid=e3cabf27-6d08-41f3-9f09-fa11b614f1d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "address": "fa:16:3e:df:cc:37", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc2024c-6b", "ovs_interfaceid": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converting VIF {"id": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "address": "fa:16:3e:df:cc:37", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc2024c-6b", "ovs_interfaceid": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:cc:37,bridge_name='br-int',has_traffic_filtering=True,id=dfc2024c-6b00-43d9-99e4-701ec0227c59,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc2024c-6b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG os_vif [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:cc:37,bridge_name='br-int',has_traffic_filtering=True,id=dfc2024c-6b00-43d9-99e4-701ec0227c59,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc2024c-6b') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfc2024c-6b, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdfc2024c-6b, col_values=(('external_ids', {'iface-id': 'dfc2024c-6b00-43d9-99e4-701ec0227c59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:cc:37', 'vm-uuid': 'e3cabf27-6d08-41f3-9f09-fa11b614f1d0'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:08 user nova-compute[71364]: INFO os_vif [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:cc:37,bridge_name='br-int',has_traffic_filtering=True,id=dfc2024c-6b00-43d9-99e4-701ec0227c59,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc2024c-6b')
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No VIF found with MAC fa:16:3e:df:cc:37, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.network.neutron [req-9f465cf3-087a-4c3e-97b9-6cabdd368acc req-8031ec06-c981-404f-b874-5360fa4babb3 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Updated VIF entry in instance network info cache for port 3b90af5a-ae8d-4876-bda9-002751948bb0. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.network.neutron [req-9f465cf3-087a-4c3e-97b9-6cabdd368acc req-8031ec06-c981-404f-b874-5360fa4babb3 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Updating instance_info_cache with network_info: [{"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9f465cf3-087a-4c3e-97b9-6cabdd368acc req-8031ec06-c981-404f-b874-5360fa4babb3 service nova] Releasing lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.network.neutron [req-5888396a-cd96-4ce5-8541-b75ea87ce24e req-df54d2ae-286d-4a70-8d4e-71f40ee56b43 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Updated VIF entry in instance network info cache for port dfc2024c-6b00-43d9-99e4-701ec0227c59. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG nova.network.neutron [req-5888396a-cd96-4ce5-8541-b75ea87ce24e req-df54d2ae-286d-4a70-8d4e-71f40ee56b43 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Updating instance_info_cache with network_info: [{"id": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "address": "fa:16:3e:df:cc:37", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc2024c-6b", "ovs_interfaceid": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:03:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5888396a-cd96-4ce5-8541-b75ea87ce24e req-df54d2ae-286d-4a70-8d4e-71f40ee56b43 service nova] Releasing lock "refresh_cache-e3cabf27-6d08-41f3-9f09-fa11b614f1d0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:03:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:10 user nova-compute[71364]: DEBUG nova.compute.manager [req-579dd22d-d42e-4c14-9c64-6de2836c47d3 req-e6dfac10-1611-45b1-b03c-5d2aec1cc57c service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:03:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-579dd22d-d42e-4c14-9c64-6de2836c47d3 req-e6dfac10-1611-45b1-b03c-5d2aec1cc57c service nova] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-579dd22d-d42e-4c14-9c64-6de2836c47d3 req-e6dfac10-1611-45b1-b03c-5d2aec1cc57c service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-579dd22d-d42e-4c14-9c64-6de2836c47d3 req-e6dfac10-1611-45b1-b03c-5d2aec1cc57c service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:10 user nova-compute[71364]: DEBUG nova.compute.manager [req-579dd22d-d42e-4c14-9c64-6de2836c47d3 req-e6dfac10-1611-45b1-b03c-5d2aec1cc57c service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] No waiting events found dispatching network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:03:10 user nova-compute[71364]: WARNING nova.compute.manager [req-579dd22d-d42e-4c14-9c64-6de2836c47d3 req-e6dfac10-1611-45b1-b03c-5d2aec1cc57c service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received unexpected event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 for instance with vm_state building and task_state spawning.
Apr 11 22:03:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.compute.manager [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.compute.manager [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] No waiting events found dispatching network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:03:12 user nova-compute[71364]: WARNING nova.compute.manager [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received unexpected event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 for instance with vm_state building and task_state spawning.
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.compute.manager [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Received event network-vif-plugged-dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Acquiring lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.compute.manager [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] No waiting events found dispatching network-vif-plugged-dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:03:12 user nova-compute[71364]: WARNING nova.compute.manager [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Received unexpected event network-vif-plugged-dfc2024c-6b00-43d9-99e4-701ec0227c59 for instance with vm_state building and task_state spawning.
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.compute.manager [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Received event network-vif-plugged-dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Acquiring lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.compute.manager [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] No waiting events found dispatching network-vif-plugged-dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:03:12 user nova-compute[71364]: WARNING nova.compute.manager [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Received unexpected event network-vif-plugged-dfc2024c-6b00-43d9-99e4-701ec0227c59 for instance with vm_state building and task_state spawning.
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250592.9291797, b485c9c2-8fb4-4690-af26-ddfae00d5024 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:03:12 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] VM Resumed (Lifecycle Event)
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:03:12 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Instance spawned successfully.
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:03:12 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Instance spawned successfully.
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:03:12 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250592.9318812, b485c9c2-8fb4-4690-af26-ddfae00d5024 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:03:12 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] VM Started (Lifecycle Event)
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:03:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:03:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:03:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:03:13 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:03:13 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250592.934894, e3cabf27-6d08-41f3-9f09-fa11b614f1d0 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:03:13 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] VM Resumed (Lifecycle Event)
Apr 11 22:03:13 user nova-compute[71364]: INFO nova.compute.manager [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Took 7.42 seconds to spawn the instance on the hypervisor.
Apr 11 22:03:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:03:13 user nova-compute[71364]: INFO nova.compute.manager [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Took 6.76 seconds to spawn the instance on the hypervisor.
Apr 11 22:03:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:03:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:03:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:03:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:13 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:03:13 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250592.9367063, e3cabf27-6d08-41f3-9f09-fa11b614f1d0 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:03:13 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] VM Started (Lifecycle Event)
Apr 11 22:03:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:03:13 user nova-compute[71364]: INFO nova.compute.manager [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Took 8.17 seconds to build instance.
Apr 11 22:03:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:03:13 user nova-compute[71364]: INFO nova.compute.manager [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Took 7.90 seconds to build instance.
Apr 11 22:03:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.257s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.995s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:18 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250583.8760765, 53530e4f-a899-496d-8b83-a3b5f7dbc7ea => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:03:18 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] VM Stopped (Lifecycle Event)
Apr 11 22:03:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-6168c182-c705-484c-b9dc-06765be9ebe4 None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:03:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-6168c182-c705-484c-b9dc-06765be9ebe4 None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:03:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:31 user nova-compute[71364]: INFO nova.compute.manager [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Terminating instance
Apr 11 22:03:31 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:03:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-aa32b0a2-27e5-46e4-b971-38e405ecbc58 req-87543e86-46c8-4534-98f6-7530e034a34e service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-unplugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:03:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-aa32b0a2-27e5-46e4-b971-38e405ecbc58 req-87543e86-46c8-4534-98f6-7530e034a34e service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-aa32b0a2-27e5-46e4-b971-38e405ecbc58 req-87543e86-46c8-4534-98f6-7530e034a34e service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-aa32b0a2-27e5-46e4-b971-38e405ecbc58 req-87543e86-46c8-4534-98f6-7530e034a34e service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-aa32b0a2-27e5-46e4-b971-38e405ecbc58 req-87543e86-46c8-4534-98f6-7530e034a34e service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-unplugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:03:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-aa32b0a2-27e5-46e4-b971-38e405ecbc58 req-87543e86-46c8-4534-98f6-7530e034a34e service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-unplugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:03:32 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Instance destroyed successfully.
Apr 11 22:03:32 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'resources' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T21:50:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1842337295',display_name='tempest-ServerActionsTestJSON-server-349398715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1842337295',id=4,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-c34k408a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:00:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=5ff9bbaf-1a5e-4acd-aca3-d956728312cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "6144f13d-b463-46ef-b75b-d2d982198b72", "address": "fa:16:3e:44:2c:d8", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6144f13d-b4", "ovs_interfaceid": "6144f13d-b463-46ef-b75b-d2d982198b72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_vif [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6144f13d-b4, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:32 user nova-compute[71364]: INFO os_vif [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:2c:d8,bridge_name='br-int',has_traffic_filtering=True,id=6144f13d-b463-46ef-b75b-d2d982198b72,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6144f13d-b4')
Apr 11 22:03:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dImUioOB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:03:32 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefda163-db69-48c1-aea5-a0168ad0f11f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:03:32 user nova-compute[71364]: No targets found.
Apr 11 22:03:32 user nova-compute[71364]: iSNS:
Apr 11 22:03:32 user nova-compute[71364]: No targets found.
Apr 11 22:03:32 user nova-compute[71364]: STATIC:
Apr 11 22:03:32 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:03:32 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:03:32 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:03:32 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab
Apr 11 22:03:32 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:03:32 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:03:32 user nova-compute[71364]: FIRMWARE:
Apr 11 22:03:32 user nova-compute[71364]: No targets found.
Apr 11 22:03:32 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:03:32 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:03:32 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda3683c-31f9-4909-ab36-c2e1005037ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c743ef-9304-4e16-89e4-d8299233444a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:03:32 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:03:32 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:03:32 user nova-compute[71364]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab (non-flash)
Apr 11 22:03:32 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4baccd11b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab'): ({'sdd'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Removing single pathed devices sdd {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[320ff974-be8c-4e34-b715-23ca367137b4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[693b2ca3-ff90-4ba4-af1b-24fcfda147b6]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flushing IO for device /dev/sdd {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce5d938-8150-430e-a5c7-ecbeb64e2286]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[29faec4d-b812-45a3-afde-7f0d6f886983]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5619145d-5e24-44a4-aae7-e3889775cbb6]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[98925b41-a24a-40c8-9056-2b568c16334c]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260]
Apr 11 22:03:32 user nova-compute[71364]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab, portal: 172.16.0.220,3260] successful.
Apr 11 22:03:32 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b60671b-b0ac-47d4-8d1a-8001771bd0ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[038302af-0efb-481b-a52b-d58aa795de7a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== disconnect_volume: return (296ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:03:32 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Deleting instance files /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb_del
Apr 11 22:03:32 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Deletion of /opt/stack/data/nova/instances/5ff9bbaf-1a5e-4acd-aca3-d956728312cb_del complete
Apr 11 22:03:32 user nova-compute[71364]: INFO nova.compute.manager [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 11 22:03:32 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:03:32 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-9c66b26b-b337-4257-aece-3cc18c430438 req-a12710f5-f1a9-4c1a-8867-79d558f90e27 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-deleted-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:03:33 user nova-compute[71364]: INFO nova.compute.manager [req-9c66b26b-b337-4257-aece-3cc18c430438 req-a12710f5-f1a9-4c1a-8867-79d558f90e27 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Neutron deleted interface 6144f13d-b463-46ef-b75b-d2d982198b72; detaching it from the instance and deleting it from the info cache
Apr 11 22:03:33 user nova-compute[71364]: DEBUG nova.network.neutron [req-9c66b26b-b337-4257-aece-3cc18c430438 req-a12710f5-f1a9-4c1a-8867-79d558f90e27 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:03:33 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Took 0.80 seconds to deallocate network for instance.
Apr 11 22:03:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-9c66b26b-b337-4257-aece-3cc18c430438 req-a12710f5-f1a9-4c1a-8867-79d558f90e27 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Detach interface failed, port_id=6144f13d-b463-46ef-b75b-d2d982198b72, reason: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'flavor' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:33 user nova-compute[71364]: INFO nova.compute.manager [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Attaching volume 78736386-5b91-4568-9f0a-0ab56eab3442 to /dev/vdb
Apr 11 22:03:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-976c888a-7247-471b-924a-f2f48ee87441 req-df440edd-0e1a-4163-897d-541a3bf27a88 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-976c888a-7247-471b-924a-f2f48ee87441 req-df440edd-0e1a-4163-897d-541a3bf27a88 service nova] Acquiring lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-976c888a-7247-471b-924a-f2f48ee87441 req-df440edd-0e1a-4163-897d-541a3bf27a88 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-976c888a-7247-471b-924a-f2f48ee87441 req-df440edd-0e1a-4163-897d-541a3bf27a88 service nova] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-976c888a-7247-471b-924a-f2f48ee87441 req-df440edd-0e1a-4163-897d-541a3bf27a88 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] No waiting events found dispatching network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:03:33 user nova-compute[71364]: WARNING nova.compute.manager [req-976c888a-7247-471b-924a-f2f48ee87441 req-df440edd-0e1a-4163-897d-541a3bf27a88 service nova] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Received unexpected event network-vif-plugged-6144f13d-b463-46ef-b75b-d2d982198b72 for instance with vm_state active and task_state deleting.
Apr 11 22:03:33 user nova-compute[71364]: DEBUG os_brick.utils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff347fad-79c8-4777-b1a6-8cfcccc52f13]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[574afb6c-5189-4c2c-b72f-88cbe5c89031]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9811ca-1c1c-4f72-912c-8d1ab4265488]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90e85f2-5903-4df8-aebf-1034d04fa3e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:03:33 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:03:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b664eb4-6501-465d-8ace-1a911ff8a699]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG os_brick.utils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:03:33 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Updating existing volume attachment record: 8fec6e04-044d-4d9f-a2e8-cec55e16c94d {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:03:34 user nova-compute[71364]: INFO nova.compute.manager [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Took 0.80 seconds to detach 1 volumes for instance.
Apr 11 22:03:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:34 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:03:34 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:03:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:34 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Deleted allocations for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb
Apr 11 22:03:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "5ff9bbaf-1a5e-4acd-aca3-d956728312cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.397s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOnvYyBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:03:37 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:03:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:03:37 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:03:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:03:37 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:03:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[420571ca-649e-44cb-be37-c347335d9ff2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:03:37 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d528d5b9-483c-431a-a0be-d31dfbac1c80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442] added
Apr 11 22:03:37 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dbe6af-267e-4006-8409-1914da0d7206]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[da67ce88-b3c8-433a-9086-98e24b46d6d0]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOnvYyBd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOnvYyBd" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61c1730-e77d-4997-bf26-5f54e617f5f1]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kOnvYyBd'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6775e1d2-8bc2-4b3d-9de3-6b62c6913fc7]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fb2434-40a1-4065-a092-637ec69ee045]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:03:38 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:03:38 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa1af53-36dd-4d4a-89d0-5fbed37c8528]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442, portal: 172.16.0.220,3260]
Apr 11 22:03:38 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442, portal: 172.16.0.220,3260] successful.
Apr 11 22:03:38 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[545578ba-8f8f-4df4-ac61-c84666fd789d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bd8508-b63a-42c3-9e94-31a46fe98d2c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:03:38 user nova-compute[71364]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 (non-flash)
Apr 11 22:03:38 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:03:38 user nova-compute[71364]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 (non-flash)
Apr 11 22:03:38 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9e16cb-e470-4081-aee2-13afe8487831]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:38 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:03:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:39 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:03:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOnvYyBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:03:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:03:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23033353439383863', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:03:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033353439383863', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:03:39 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'flavor' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:03:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 22:03:39 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:03:39 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:03:39 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:03:39 user nova-compute[71364]:   <serial>78736386-5b91-4568-9f0a-0ab56eab3442</serial>
Apr 11 22:03:39 user nova-compute[71364]: </disk>
Apr 11 22:03:39 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 22:03:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:03:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:03:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] No VIF found with MAC fa:16:3e:49:5f:74, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:03:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.085s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:40 user nova-compute[71364]: INFO nova.compute.manager [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Detaching volume 78736386-5b91-4568-9f0a-0ab56eab3442
Apr 11 22:03:40 user nova-compute[71364]: INFO nova.virt.block_device [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Attempting to driver detach volume 78736386-5b91-4568-9f0a-0ab56eab3442 from mountpoint /dev/vdb
Apr 11 22:03:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Attempting to detach device vdb from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:03:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:03:40 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:03:40 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:03:40 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:03:40 user nova-compute[71364]:   <serial>78736386-5b91-4568-9f0a-0ab56eab3442</serial>
Apr 11 22:03:40 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:03:40 user nova-compute[71364]: </disk>
Apr 11 22:03:40 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:03:40 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Successfully detached device vdb from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the persistent domain config.
Apr 11 22:03:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:03:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:03:40 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:03:40 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:03:40 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:03:40 user nova-compute[71364]:   <serial>78736386-5b91-4568-9f0a-0ab56eab3442</serial>
Apr 11 22:03:40 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:03:40 user nova-compute[71364]: </disk>
Apr 11 22:03:40 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681250621.2574975, 5366a438-0f96-4ae2-8c99-48f98501baa3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:03:41 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Successfully detached device vdb from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the live domain config.
Apr 11 22:03:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOnvYyBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:03:41 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[351fa063-ce75-4e58-b2b0-99dbcb5adbcb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:03:41 user nova-compute[71364]: No targets found.
Apr 11 22:03:41 user nova-compute[71364]: iSNS:
Apr 11 22:03:41 user nova-compute[71364]: No targets found.
Apr 11 22:03:41 user nova-compute[71364]: STATIC:
Apr 11 22:03:41 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:03:41 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:03:41 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:03:41 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442
Apr 11 22:03:41 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:03:41 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:03:41 user nova-compute[71364]: FIRMWARE:
Apr 11 22:03:41 user nova-compute[71364]: No targets found.
Apr 11 22:03:41 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:03:41 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:03:41 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[830398b8-c64c-4d69-9b75-c1d767687618]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec99c5d-2ffe-47d1-a044-3e269b65bc70]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:03:41 user nova-compute[71364]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 (non-flash)
Apr 11 22:03:41 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:03:41 user nova-compute[71364]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 (non-flash)
Apr 11 22:03:41 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff7a0310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb034a0-88e9-42d2-92b9-ff6c2f8c9d66]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f06bb1a-b768-45d2-9857-5a1df98ab487]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed786ca-b1ef-4441-9701-7391346ed878]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a037dc0f-bcbd-4186-8470-eb5b6c164799]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5331d0c3-8173-4611-ad1c-785b2e87d4d3]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff6fe87-2d2d-4590-99c1-7ecb9e37be69]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442, portal: 172.16.0.220,3260]
Apr 11 22:03:41 user nova-compute[71364]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442, portal: 172.16.0.220,3260] successful.
Apr 11 22:03:41 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78736386-5b91-4568-9f0a-0ab56eab3442 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40b121c-8cab-4867-90c4-930aa3b61e69]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] <== disconnect_volume: return (291ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:03:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:03:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:42 user nova-compute[71364]: DEBUG nova.objects.instance [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'flavor' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:03:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.664s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:47 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250612.082422, 5ff9bbaf-1a5e-4acd-aca3-d956728312cb => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:03:47 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] VM Stopped (Lifecycle Event)
Apr 11 22:03:47 user nova-compute[71364]: DEBUG nova.compute.manager [None req-5d1ad1da-5721-4232-922a-815564af02cb None None] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:03:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:03:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:00 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:04:00 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7773MB free_disk=26.13494110107422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5366a438-0f96-4ae2-8c99-48f98501baa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d6268190-2187-4596-9f0b-026c520e5c67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b485c9c2-8fb4-4690-af26-ddfae00d5024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:04:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Updating instance_info_cache with network_info: [{"id": "2e074aaa-933c-4085-ad92-4699f1ac3975", "address": "fa:16:3e:8f:33:19", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e074aaa-93", "ovs_interfaceid": "2e074aaa-933c-4085-ad92-4699f1ac3975", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:04:02 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:04:03 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:04:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:04:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:04:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:04:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:04:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:04:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:04:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:04:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:23 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:04:23 user nova-compute[71364]: INFO nova.compute.claims [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Claim successful on node user
Apr 11 22:04:23 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:04:23 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:04:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:04:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:04:23 user nova-compute[71364]: DEBUG nova.network.neutron [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:04:23 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:04:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG nova.policy [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:04:24 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Creating image(s)
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "/opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "/opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "/opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk 1073741824" returned: 0 in 0.046s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.152s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Cannot resize image /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG nova.objects.instance [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'migration_context' on Instance uuid 9e44ad56-d695-409c-9d35-3d3dec2c3a89 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Ensure instance console log exists: /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:24 user nova-compute[71364]: DEBUG nova.network.neutron [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Successfully created port: 184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.network.neutron [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Successfully updated port: 184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquired lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.network.neutron [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-77e62b45-8373-4b75-bdc1-9715bf8dd0b1 req-5f002103-a16d-4267-a9d1-d5d64cb1fa1d service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Received event network-changed-184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-77e62b45-8373-4b75-bdc1-9715bf8dd0b1 req-5f002103-a16d-4267-a9d1-d5d64cb1fa1d service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Refreshing instance network info cache due to event network-changed-184fffcb-758c-4ac6-afbd-b3d27a38f374. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-77e62b45-8373-4b75-bdc1-9715bf8dd0b1 req-5f002103-a16d-4267-a9d1-d5d64cb1fa1d service nova] Acquiring lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.network.neutron [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.network.neutron [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Updating instance_info_cache with network_info: [{"id": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "address": "fa:16:3e:89:4e:e1", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184fffcb-75", "ovs_interfaceid": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Releasing lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.compute.manager [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Instance network_info: |[{"id": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "address": "fa:16:3e:89:4e:e1", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184fffcb-75", "ovs_interfaceid": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-77e62b45-8373-4b75-bdc1-9715bf8dd0b1 req-5f002103-a16d-4267-a9d1-d5d64cb1fa1d service nova] Acquired lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.network.neutron [req-77e62b45-8373-4b75-bdc1-9715bf8dd0b1 req-5f002103-a16d-4267-a9d1-d5d64cb1fa1d service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Refreshing network info cache for port 184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Start _get_guest_xml network_info=[{"id": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "address": "fa:16:3e:89:4e:e1", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184fffcb-75", "ovs_interfaceid": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:04:25 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:04:25 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1841742325',display_name='tempest-ServerActionsTestJSON-server-1841742325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1841742325',id=31,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-7bmafrhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=9e44ad56-d695-409c-9d35-3d3dec2c3a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "address": "fa:16:3e:89:4e:e1", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184fffcb-75", "ovs_interfaceid": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "address": "fa:16:3e:89:4e:e1", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184fffcb-75", "ovs_interfaceid": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:4e:e1,bridge_name='br-int',has_traffic_filtering=True,id=184fffcb-758c-4ac6-afbd-b3d27a38f374,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184fffcb-75') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:04:25 user nova-compute[71364]: DEBUG nova.objects.instance [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e44ad56-d695-409c-9d35-3d3dec2c3a89 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:04:26 user nova-compute[71364]:   <uuid>9e44ad56-d695-409c-9d35-3d3dec2c3a89</uuid>
Apr 11 22:04:26 user nova-compute[71364]:   <name>instance-0000001f</name>
Apr 11 22:04:26 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:04:26 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:04:26 user nova-compute[71364]:   <metadata>
Apr 11 22:04:26 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:04:26 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:04:26 user nova-compute[71364]:       <nova:name>tempest-ServerActionsTestJSON-server-1841742325</nova:name>
Apr 11 22:04:26 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:04:25</nova:creationTime>
Apr 11 22:04:26 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:04:26 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:04:26 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:04:26 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:04:26 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:04:26 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:04:26 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:04:26 user nova-compute[71364]:       <nova:owner>
Apr 11 22:04:26 user nova-compute[71364]:         <nova:user uuid="939785ef89cb491aae3df4f411b2543d">tempest-ServerActionsTestJSON-434853204-project-member</nova:user>
Apr 11 22:04:26 user nova-compute[71364]:         <nova:project uuid="c9fff7d112a94e7da6bf166a6f628fed">tempest-ServerActionsTestJSON-434853204</nova:project>
Apr 11 22:04:26 user nova-compute[71364]:       </nova:owner>
Apr 11 22:04:26 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:04:26 user nova-compute[71364]:       <nova:ports>
Apr 11 22:04:26 user nova-compute[71364]:         <nova:port uuid="184fffcb-758c-4ac6-afbd-b3d27a38f374">
Apr 11 22:04:26 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 22:04:26 user nova-compute[71364]:         </nova:port>
Apr 11 22:04:26 user nova-compute[71364]:       </nova:ports>
Apr 11 22:04:26 user nova-compute[71364]:     </nova:instance>
Apr 11 22:04:26 user nova-compute[71364]:   </metadata>
Apr 11 22:04:26 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:04:26 user nova-compute[71364]:     <system>
Apr 11 22:04:26 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:04:26 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:04:26 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:04:26 user nova-compute[71364]:       <entry name="serial">9e44ad56-d695-409c-9d35-3d3dec2c3a89</entry>
Apr 11 22:04:26 user nova-compute[71364]:       <entry name="uuid">9e44ad56-d695-409c-9d35-3d3dec2c3a89</entry>
Apr 11 22:04:26 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:04:26 user nova-compute[71364]:     </system>
Apr 11 22:04:26 user nova-compute[71364]:   </sysinfo>
Apr 11 22:04:26 user nova-compute[71364]:   <os>
Apr 11 22:04:26 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:04:26 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:04:26 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:04:26 user nova-compute[71364]:   </os>
Apr 11 22:04:26 user nova-compute[71364]:   <features>
Apr 11 22:04:26 user nova-compute[71364]:     <acpi/>
Apr 11 22:04:26 user nova-compute[71364]:     <apic/>
Apr 11 22:04:26 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:04:26 user nova-compute[71364]:   </features>
Apr 11 22:04:26 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:04:26 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:04:26 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:04:26 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:04:26 user nova-compute[71364]:   </clock>
Apr 11 22:04:26 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:04:26 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:04:26 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:04:26 user nova-compute[71364]:   </cpu>
Apr 11 22:04:26 user nova-compute[71364]:   <devices>
Apr 11 22:04:26 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:04:26 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:04:26 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk"/>
Apr 11 22:04:26 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:04:26 user nova-compute[71364]:     </disk>
Apr 11 22:04:26 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:04:26 user nova-compute[71364]:       <mac address="fa:16:3e:89:4e:e1"/>
Apr 11 22:04:26 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:04:26 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:04:26 user nova-compute[71364]:       <target dev="tap184fffcb-75"/>
Apr 11 22:04:26 user nova-compute[71364]:     </interface>
Apr 11 22:04:26 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:04:26 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/console.log" append="off"/>
Apr 11 22:04:26 user nova-compute[71364]:     </serial>
Apr 11 22:04:26 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:04:26 user nova-compute[71364]:     <video>
Apr 11 22:04:26 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:04:26 user nova-compute[71364]:     </video>
Apr 11 22:04:26 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:04:26 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:04:26 user nova-compute[71364]:     </rng>
Apr 11 22:04:26 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:04:26 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:04:26 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:04:26 user nova-compute[71364]:     </memballoon>
Apr 11 22:04:26 user nova-compute[71364]:   </devices>
Apr 11 22:04:26 user nova-compute[71364]: </domain>
Apr 11 22:04:26 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1841742325',display_name='tempest-ServerActionsTestJSON-server-1841742325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1841742325',id=31,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-7bmafrhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=9e44ad56-d695-409c-9d35-3d3dec2c3a89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "address": "fa:16:3e:89:4e:e1", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184fffcb-75", "ovs_interfaceid": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "address": "fa:16:3e:89:4e:e1", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184fffcb-75", "ovs_interfaceid": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:4e:e1,bridge_name='br-int',has_traffic_filtering=True,id=184fffcb-758c-4ac6-afbd-b3d27a38f374,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184fffcb-75') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG os_vif [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:4e:e1,bridge_name='br-int',has_traffic_filtering=True,id=184fffcb-758c-4ac6-afbd-b3d27a38f374,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184fffcb-75') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap184fffcb-75, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap184fffcb-75, col_values=(('external_ids', {'iface-id': '184fffcb-758c-4ac6-afbd-b3d27a38f374', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:4e:e1', 'vm-uuid': '9e44ad56-d695-409c-9d35-3d3dec2c3a89'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:26 user nova-compute[71364]: INFO os_vif [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:4e:e1,bridge_name='br-int',has_traffic_filtering=True,id=184fffcb-758c-4ac6-afbd-b3d27a38f374,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184fffcb-75')
Apr 11 22:04:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No VIF found with MAC fa:16:3e:89:4e:e1, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG nova.network.neutron [req-77e62b45-8373-4b75-bdc1-9715bf8dd0b1 req-5f002103-a16d-4267-a9d1-d5d64cb1fa1d service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Updated VIF entry in instance network info cache for port 184fffcb-758c-4ac6-afbd-b3d27a38f374. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG nova.network.neutron [req-77e62b45-8373-4b75-bdc1-9715bf8dd0b1 req-5f002103-a16d-4267-a9d1-d5d64cb1fa1d service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Updating instance_info_cache with network_info: [{"id": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "address": "fa:16:3e:89:4e:e1", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184fffcb-75", "ovs_interfaceid": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:04:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-77e62b45-8373-4b75-bdc1-9715bf8dd0b1 req-5f002103-a16d-4267-a9d1-d5d64cb1fa1d service nova] Releasing lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:04:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-d96e8181-84cb-4950-b609-b9c423cfe71b req-099f92ed-e934-4768-8d74-a4b2414b99d6 service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Received event network-vif-plugged-184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:04:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d96e8181-84cb-4950-b609-b9c423cfe71b req-099f92ed-e934-4768-8d74-a4b2414b99d6 service nova] Acquiring lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d96e8181-84cb-4950-b609-b9c423cfe71b req-099f92ed-e934-4768-8d74-a4b2414b99d6 service nova] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d96e8181-84cb-4950-b609-b9c423cfe71b req-099f92ed-e934-4768-8d74-a4b2414b99d6 service nova] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-d96e8181-84cb-4950-b609-b9c423cfe71b req-099f92ed-e934-4768-8d74-a4b2414b99d6 service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] No waiting events found dispatching network-vif-plugged-184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:04:27 user nova-compute[71364]: WARNING nova.compute.manager [req-d96e8181-84cb-4950-b609-b9c423cfe71b req-099f92ed-e934-4768-8d74-a4b2414b99d6 service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Received unexpected event network-vif-plugged-184fffcb-758c-4ac6-afbd-b3d27a38f374 for instance with vm_state building and task_state spawning.
Apr 11 22:04:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250669.4134502, 9e44ad56-d695-409c-9d35-3d3dec2c3a89 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:04:29 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] VM Resumed (Lifecycle Event)
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.compute.manager [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:04:29 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Instance spawned successfully.
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:04:29 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250669.4173791, 9e44ad56-d695-409c-9d35-3d3dec2c3a89 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:04:29 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] VM Started (Lifecycle Event)
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:04:29 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:04:29 user nova-compute[71364]: INFO nova.compute.manager [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Took 5.38 seconds to spawn the instance on the hypervisor.
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.compute.manager [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:04:29 user nova-compute[71364]: INFO nova.compute.manager [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Took 6.28 seconds to build instance.
Apr 11 22:04:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.481s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-985fc2ef-12b8-4a0b-bd24-f5b2bbff0757 req-93a9a67c-847a-47b5-8b93-77ac8cd6f5b3 service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Received event network-vif-plugged-184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-985fc2ef-12b8-4a0b-bd24-f5b2bbff0757 req-93a9a67c-847a-47b5-8b93-77ac8cd6f5b3 service nova] Acquiring lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-985fc2ef-12b8-4a0b-bd24-f5b2bbff0757 req-93a9a67c-847a-47b5-8b93-77ac8cd6f5b3 service nova] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-985fc2ef-12b8-4a0b-bd24-f5b2bbff0757 req-93a9a67c-847a-47b5-8b93-77ac8cd6f5b3 service nova] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-985fc2ef-12b8-4a0b-bd24-f5b2bbff0757 req-93a9a67c-847a-47b5-8b93-77ac8cd6f5b3 service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] No waiting events found dispatching network-vif-plugged-184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:04:29 user nova-compute[71364]: WARNING nova.compute.manager [req-985fc2ef-12b8-4a0b-bd24-f5b2bbff0757 req-93a9a67c-847a-47b5-8b93-77ac8cd6f5b3 service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Received unexpected event network-vif-plugged-184fffcb-758c-4ac6-afbd-b3d27a38f374 for instance with vm_state active and task_state None.
Apr 11 22:04:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:30 user nova-compute[71364]: INFO nova.compute.manager [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Terminating instance
Apr 11 22:04:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-89b3f068-00a3-43c8-a02e-e8e33d2e63b8 req-08e4ead0-fe98-408b-80d7-dec45b77798b service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Received event network-vif-unplugged-b581b302-d2b3-4038-b1e3-7e0474ba6bec {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-89b3f068-00a3-43c8-a02e-e8e33d2e63b8 req-08e4ead0-fe98-408b-80d7-dec45b77798b service nova] Acquiring lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-89b3f068-00a3-43c8-a02e-e8e33d2e63b8 req-08e4ead0-fe98-408b-80d7-dec45b77798b service nova] Lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-89b3f068-00a3-43c8-a02e-e8e33d2e63b8 req-08e4ead0-fe98-408b-80d7-dec45b77798b service nova] Lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-89b3f068-00a3-43c8-a02e-e8e33d2e63b8 req-08e4ead0-fe98-408b-80d7-dec45b77798b service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] No waiting events found dispatching network-vif-unplugged-b581b302-d2b3-4038-b1e3-7e0474ba6bec {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-89b3f068-00a3-43c8-a02e-e8e33d2e63b8 req-08e4ead0-fe98-408b-80d7-dec45b77798b service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Received event network-vif-unplugged-b581b302-d2b3-4038-b1e3-7e0474ba6bec for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:04:30 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Instance destroyed successfully.
Apr 11 22:04:30 user nova-compute[71364]: DEBUG nova.objects.instance [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lazy-loading 'resources' on Instance uuid b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1033299063',display_name='tempest-VolumesActionsTest-instance-1033299063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1033299063',id=27,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:02:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf1f96aca4e547ef93d0d811ab4a8840',ramdisk_id='',reservation_id='r-1rftm06u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-214311813',owner_user_name='tempest-VolumesActionsTest-214311813-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:02:46Z,user_data=None,user_id='c88df8be325448df9b24d49c3a7f6504',uuid=b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "address": "fa:16:3e:39:3c:ff", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb581b302-d2", "ovs_interfaceid": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Converting VIF {"id": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "address": "fa:16:3e:39:3c:ff", "network": {"id": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-957694296-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bf1f96aca4e547ef93d0d811ab4a8840", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb581b302-d2", "ovs_interfaceid": "b581b302-d2b3-4038-b1e3-7e0474ba6bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:3c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b581b302-d2b3-4038-b1e3-7e0474ba6bec,network=Network(0c9b930b-ce00-4ef1-9c4f-057d0212e71d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb581b302-d2') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG os_vif [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:3c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b581b302-d2b3-4038-b1e3-7e0474ba6bec,network=Network(0c9b930b-ce00-4ef1-9c4f-057d0212e71d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb581b302-d2') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb581b302-d2, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:30 user nova-compute[71364]: INFO os_vif [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:3c:ff,bridge_name='br-int',has_traffic_filtering=True,id=b581b302-d2b3-4038-b1e3-7e0474ba6bec,network=Network(0c9b930b-ce00-4ef1-9c4f-057d0212e71d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb581b302-d2')
Apr 11 22:04:30 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Deleting instance files /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a_del
Apr 11 22:04:30 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Deletion of /opt/stack/data/nova/instances/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a_del complete
Apr 11 22:04:30 user nova-compute[71364]: INFO nova.compute.manager [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 11 22:04:30 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:04:30 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:04:31 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:04:31 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Took 0.46 seconds to deallocate network for instance.
Apr 11 22:04:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:31 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:04:31 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:04:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:31 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Deleted allocations for instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a
Apr 11 22:04:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.719s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-3e19a37f-9bf0-48b0-8663-805b431d1d38 req-2f610803-b279-4bed-afe6-11c3996d7fc2 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Received event network-vif-plugged-b581b302-d2b3-4038-b1e3-7e0474ba6bec {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3e19a37f-9bf0-48b0-8663-805b431d1d38 req-2f610803-b279-4bed-afe6-11c3996d7fc2 service nova] Acquiring lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3e19a37f-9bf0-48b0-8663-805b431d1d38 req-2f610803-b279-4bed-afe6-11c3996d7fc2 service nova] Lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3e19a37f-9bf0-48b0-8663-805b431d1d38 req-2f610803-b279-4bed-afe6-11c3996d7fc2 service nova] Lock "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-3e19a37f-9bf0-48b0-8663-805b431d1d38 req-2f610803-b279-4bed-afe6-11c3996d7fc2 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] No waiting events found dispatching network-vif-plugged-b581b302-d2b3-4038-b1e3-7e0474ba6bec {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:04:32 user nova-compute[71364]: WARNING nova.compute.manager [req-3e19a37f-9bf0-48b0-8663-805b431d1d38 req-2f610803-b279-4bed-afe6-11c3996d7fc2 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Received unexpected event network-vif-plugged-b581b302-d2b3-4038-b1e3-7e0474ba6bec for instance with vm_state deleted and task_state None.
Apr 11 22:04:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-3e19a37f-9bf0-48b0-8663-805b431d1d38 req-2f610803-b279-4bed-afe6-11c3996d7fc2 service nova] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Received event network-vif-deleted-b581b302-d2b3-4038-b1e3-7e0474ba6bec {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG nova.objects.instance [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'flavor' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:32 user nova-compute[71364]: INFO nova.compute.manager [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Attaching volume a806af74-583e-475d-bd9d-2ced829114b7 to /dev/vdb
Apr 11 22:04:32 user nova-compute[71364]: DEBUG os_brick.utils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd7593a-1c8e-4c97-9190-3a396d182624]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35c0565-1bfd-4680-be44-3580b3a26288]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc14420-c754-4e72-aeeb-e34d7d858522]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b04134e-c337-41d7-b4e9-88562d1269fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:04:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:04:33 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:04:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f750284f-b1c0-4cd9-9de9-93276938c6fc]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:04:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:04:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:04:33 user nova-compute[71364]: DEBUG os_brick.utils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:04:33 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Updating existing volume attachment record: 98adec64-3aae-42ac-8fca-67c6133facab {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:04:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:35 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:04:35 user nova-compute[71364]: INFO nova.compute.manager [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] instance snapshotting
Apr 11 22:04:35 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Beginning live snapshot process
Apr 11 22:04:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json -f qcow2 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json -f qcow2 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json -f qcow2" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfteg8w89/430373704e1e40c087e372be65d05f8e.delta 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfteg8w89/430373704e1e40c087e372be65d05f8e.delta 1073741824" returned: 0 in 0.051s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:36 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 11 22:04:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 22:04:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71364) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 11 22:04:37 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 11 22:04:37 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 22:04:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfteg8w89/430373704e1e40c087e372be65d05f8e.delta /opt/stack/data/nova/instances/snapshots/tmpfteg8w89/430373704e1e40c087e372be65d05f8e {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfteg8w89/430373704e1e40c087e372be65d05f8e.delta /opt/stack/data/nova/instances/snapshots/tmpfteg8w89/430373704e1e40c087e372be65d05f8e" returned: 0 in 0.392s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:37 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Snapshot extracted, beginning image upload
Apr 11 22:04:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:04:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUQahnAk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:04:37 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:04:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:04:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:04:37 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:04:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:04:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:04:37 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:04:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:37 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[173cf8da-8432-4913-b07c-bb44df2bbef9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:04:37 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:04:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0da759e-dc0c-4793-a99f-c2e355ccb472]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7] added
Apr 11 22:04:38 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[25734177-3da7-438c-abdc-5e807dce6426]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e974a2df-fb13-44d1-b750-62bd40151920]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUQahnAk {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HUQahnAk" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb92322a-a074-43aa-89c6-4f307d4495c8]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HUQahnAk'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b91f32-225e-4da0-aaca-2792154b012f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b031d03a-fad4-40bb-a8e3-68d51bd67ad7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:04:38 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:04:38 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5dbbf9-e665-4d90-bf53-f57e8bf686a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7, portal: 172.16.0.220,3260]
Apr 11 22:04:38 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7, portal: 172.16.0.220,3260] successful.
Apr 11 22:04:38 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b873ce0e-68ea-46ad-b2c5-ca9123e0c163]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b27220-ec79-4931-b150-e8c6c985cd50]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:04:38 user nova-compute[71364]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 (non-flash)
Apr 11 22:04:38 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:04:38 user nova-compute[71364]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 (non-flash)
Apr 11 22:04:38 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0958327a-4007-4a34-be79-0d87cd7ac712]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:04:38 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUQahnAk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:04:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:04:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23630343335316639', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:04:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630343335316639', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:04:39 user nova-compute[71364]: DEBUG nova.objects.instance [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'flavor' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 22:04:39 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:04:39 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:04:39 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:04:39 user nova-compute[71364]:   <serial>a806af74-583e-475d-bd9d-2ced829114b7</serial>
Apr 11 22:04:39 user nova-compute[71364]: </disk>
Apr 11 22:04:39 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 22:04:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:04:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:04:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] No VIF found with MAC fa:16:3e:49:5f:74, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:04:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.057s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:40 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Snapshot image upload complete
Apr 11 22:04:40 user nova-compute[71364]: INFO nova.compute.manager [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Took 4.82 seconds to snapshot the instance on the hypervisor.
Apr 11 22:04:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:40 user nova-compute[71364]: INFO nova.compute.manager [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Detaching volume a806af74-583e-475d-bd9d-2ced829114b7
Apr 11 22:04:41 user nova-compute[71364]: INFO nova.virt.block_device [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Attempting to driver detach volume a806af74-583e-475d-bd9d-2ced829114b7 from mountpoint /dev/vdb
Apr 11 22:04:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Attempting to detach device vdb from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:04:41 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:04:41 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:04:41 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:04:41 user nova-compute[71364]:   <serial>a806af74-583e-475d-bd9d-2ced829114b7</serial>
Apr 11 22:04:41 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:04:41 user nova-compute[71364]: </disk>
Apr 11 22:04:41 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:04:41 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Successfully detached device vdb from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the persistent domain config.
Apr 11 22:04:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:04:41 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:04:41 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:04:41 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:04:41 user nova-compute[71364]:   <serial>a806af74-583e-475d-bd9d-2ced829114b7</serial>
Apr 11 22:04:41 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:04:41 user nova-compute[71364]: </disk>
Apr 11 22:04:41 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681250681.4907582, 5366a438-0f96-4ae2-8c99-48f98501baa3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:04:41 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Successfully detached device vdb from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the live domain config.
Apr 11 22:04:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HUQahnAk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:04:41 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb763be-6b52-4f75-91f3-5c340d53b403]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:04:41 user nova-compute[71364]: No targets found.
Apr 11 22:04:41 user nova-compute[71364]: iSNS:
Apr 11 22:04:41 user nova-compute[71364]: No targets found.
Apr 11 22:04:41 user nova-compute[71364]: STATIC:
Apr 11 22:04:41 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:04:41 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:04:41 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:04:41 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7
Apr 11 22:04:41 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:04:41 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:04:41 user nova-compute[71364]: FIRMWARE:
Apr 11 22:04:41 user nova-compute[71364]: No targets found.
Apr 11 22:04:41 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:04:41 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:04:41 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efb03b2-9706-4ce6-b59e-30e005b66e53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47fa7b0-09e5-460f-8b21-dcf84e3bbaf0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:04:41 user nova-compute[71364]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 (non-flash)
Apr 11 22:04:41 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:04:41 user nova-compute[71364]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 (non-flash)
Apr 11 22:04:41 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bf02bd1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f874f2-7d35-4fbf-aa3a-bf5f5ae7df9e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6c30d0-f69d-4e9e-bf48-a084c8d52cd3]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b754c6ae-8d0b-4d79-aba0-0309a83e1edd]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e36dfc-411a-4f49-8667-4c9a4d7ce8d7]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f594c7ff-66cb-44bd-b3f7-dec403bf5a77]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe8215b-8e8e-4f18-8bae-526e24ba6507]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7, portal: 172.16.0.220,3260]
Apr 11 22:04:41 user nova-compute[71364]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7, portal: 172.16.0.220,3260] successful.
Apr 11 22:04:41 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a806af74-583e-475d-bd9d-2ced829114b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a8be3c-2cc4-47d1-8a8c-4377e9542be9]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] <== disconnect_volume: return (290ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:04:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:04:42 user nova-compute[71364]: DEBUG nova.objects.instance [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'flavor' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.598s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:45 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250670.651145, b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:04:45 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] VM Stopped (Lifecycle Event)
Apr 11 22:04:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-7c4b1150-1f5a-4578-bfec-9b0e082b8dc3 None None] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:04:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:53 user nova-compute[71364]: DEBUG nova.objects.instance [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'flavor' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:04:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquired lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:04:53 user nova-compute[71364]: DEBUG nova.network.neutron [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:04:53 user nova-compute[71364]: DEBUG nova.objects.instance [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'info_cache' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.network.neutron [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Updating instance_info_cache with network_info: [{"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Releasing lock "refresh_cache-53530e4f-a899-496d-8b83-a3b5f7dbc7ea" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:04:54 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Instance destroyed successfully.
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.objects.instance [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'resources' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-725789604',display_name='tempest-AttachVolumeTestJSON-server-725789604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-725789604',id=23,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYwKlNnt0rCNL8sjxDa6Udl9GHywucHycueHP/WPlPumIvAabJq5jTPAthhGusMxnokX9UxhPJGgZI9+13actfeG6CHskRBehNb6fTqc1ot1bspfEW3rpY449P/8ec+gw==',key_name='tempest-keypair-654553624',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5aa35cf81ae74532a074bde65f192848',ramdisk_id='',reservation_id='r-q3i4b0c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1865595781',owner_user_name='tempest-AttachVolumeTestJSON-1865595781-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:03:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76211a47ed9b4a8abdeeea98c774d3d7',uuid=53530e4f-a899-496d-8b83-a3b5f7dbc7ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converting VIF {"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG os_vif [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap914c7aea-32, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:04:54 user nova-compute[71364]: INFO os_vif [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32')
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Start _get_guest_xml network_info=[{"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.objects.instance [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'numa_topology' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:54 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:04:54 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.objects.instance [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'vcpu_model' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-725789604',display_name='tempest-AttachVolumeTestJSON-server-725789604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-725789604',id=23,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYwKlNnt0rCNL8sjxDa6Udl9GHywucHycueHP/WPlPumIvAabJq5jTPAthhGusMxnokX9UxhPJGgZI9+13actfeG6CHskRBehNb6fTqc1ot1bspfEW3rpY449P/8ec+gw==',key_name='tempest-keypair-654553624',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5aa35cf81ae74532a074bde65f192848',ramdisk_id='',reservation_id='r-q3i4b0c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1865595781',owner_user_name='tempest-AttachVolumeTestJSON-1865595781-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:03:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76211a47ed9b4a8abdeeea98c774d3d7',uuid=53530e4f-a899-496d-8b83-a3b5f7dbc7ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converting VIF {"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.objects.instance [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'pci_devices' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:04:54 user nova-compute[71364]:   <uuid>53530e4f-a899-496d-8b83-a3b5f7dbc7ea</uuid>
Apr 11 22:04:54 user nova-compute[71364]:   <name>instance-00000017</name>
Apr 11 22:04:54 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:04:54 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:04:54 user nova-compute[71364]:   <metadata>
Apr 11 22:04:54 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:04:54 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:04:54 user nova-compute[71364]:       <nova:name>tempest-AttachVolumeTestJSON-server-725789604</nova:name>
Apr 11 22:04:54 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:04:54</nova:creationTime>
Apr 11 22:04:54 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:04:54 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:04:54 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:04:54 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:04:54 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:04:54 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:04:54 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:04:54 user nova-compute[71364]:       <nova:owner>
Apr 11 22:04:54 user nova-compute[71364]:         <nova:user uuid="76211a47ed9b4a8abdeeea98c774d3d7">tempest-AttachVolumeTestJSON-1865595781-project-member</nova:user>
Apr 11 22:04:54 user nova-compute[71364]:         <nova:project uuid="5aa35cf81ae74532a074bde65f192848">tempest-AttachVolumeTestJSON-1865595781</nova:project>
Apr 11 22:04:54 user nova-compute[71364]:       </nova:owner>
Apr 11 22:04:54 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:04:54 user nova-compute[71364]:       <nova:ports>
Apr 11 22:04:54 user nova-compute[71364]:         <nova:port uuid="914c7aea-325c-4061-893a-353590f63b84">
Apr 11 22:04:54 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 22:04:54 user nova-compute[71364]:         </nova:port>
Apr 11 22:04:54 user nova-compute[71364]:       </nova:ports>
Apr 11 22:04:54 user nova-compute[71364]:     </nova:instance>
Apr 11 22:04:54 user nova-compute[71364]:   </metadata>
Apr 11 22:04:54 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:04:54 user nova-compute[71364]:     <system>
Apr 11 22:04:54 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:04:54 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:04:54 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:04:54 user nova-compute[71364]:       <entry name="serial">53530e4f-a899-496d-8b83-a3b5f7dbc7ea</entry>
Apr 11 22:04:54 user nova-compute[71364]:       <entry name="uuid">53530e4f-a899-496d-8b83-a3b5f7dbc7ea</entry>
Apr 11 22:04:54 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:04:54 user nova-compute[71364]:     </system>
Apr 11 22:04:54 user nova-compute[71364]:   </sysinfo>
Apr 11 22:04:54 user nova-compute[71364]:   <os>
Apr 11 22:04:54 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:04:54 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:04:54 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:04:54 user nova-compute[71364]:   </os>
Apr 11 22:04:54 user nova-compute[71364]:   <features>
Apr 11 22:04:54 user nova-compute[71364]:     <acpi/>
Apr 11 22:04:54 user nova-compute[71364]:     <apic/>
Apr 11 22:04:54 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:04:54 user nova-compute[71364]:   </features>
Apr 11 22:04:54 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:04:54 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:04:54 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:04:54 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:04:54 user nova-compute[71364]:   </clock>
Apr 11 22:04:54 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:04:54 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:04:54 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:04:54 user nova-compute[71364]:   </cpu>
Apr 11 22:04:54 user nova-compute[71364]:   <devices>
Apr 11 22:04:54 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:04:54 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:04:54 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk"/>
Apr 11 22:04:54 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:04:54 user nova-compute[71364]:     </disk>
Apr 11 22:04:54 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:04:54 user nova-compute[71364]:       <mac address="fa:16:3e:fb:64:5e"/>
Apr 11 22:04:54 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:04:54 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:04:54 user nova-compute[71364]:       <target dev="tap914c7aea-32"/>
Apr 11 22:04:54 user nova-compute[71364]:     </interface>
Apr 11 22:04:54 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:04:54 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/console.log" append="off"/>
Apr 11 22:04:54 user nova-compute[71364]:     </serial>
Apr 11 22:04:54 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:04:54 user nova-compute[71364]:     <video>
Apr 11 22:04:54 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:04:54 user nova-compute[71364]:     </video>
Apr 11 22:04:54 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:04:54 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:04:54 user nova-compute[71364]:     </rng>
Apr 11 22:04:54 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:04:54 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:04:54 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:04:54 user nova-compute[71364]:     </memballoon>
Apr 11 22:04:54 user nova-compute[71364]:   </devices>
Apr 11 22:04:54 user nova-compute[71364]: </domain>
Apr 11 22:04:54 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.objects.instance [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'trusted_certs' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Cannot resize image /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:04:54 user nova-compute[71364]: DEBUG nova.objects.instance [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'migration_context' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-725789604',display_name='tempest-AttachVolumeTestJSON-server-725789604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-725789604',id=23,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYwKlNnt0rCNL8sjxDa6Udl9GHywucHycueHP/WPlPumIvAabJq5jTPAthhGusMxnokX9UxhPJGgZI9+13actfeG6CHskRBehNb6fTqc1ot1bspfEW3rpY449P/8ec+gw==',key_name='tempest-keypair-654553624',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='5aa35cf81ae74532a074bde65f192848',ramdisk_id='',reservation_id='r-q3i4b0c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1865595781',owner_user_name='tempest-AttachVolumeTestJSON-1865595781-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:03:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76211a47ed9b4a8abdeeea98c774d3d7',uuid=53530e4f-a899-496d-8b83-a3b5f7dbc7ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:04:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converting VIF {"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:04:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:04:55 user nova-compute[71364]: DEBUG os_vif [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:04:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:04:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:04:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap914c7aea-32, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:04:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap914c7aea-32, col_values=(('external_ids', {'iface-id': '914c7aea-325c-4061-893a-353590f63b84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:64:5e', 'vm-uuid': '53530e4f-a899-496d-8b83-a3b5f7dbc7ea'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:04:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:04:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:55 user nova-compute[71364]: INFO os_vif [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32')
Apr 11 22:04:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-53216f39-f3da-470e-90ae-d1babf4d043b req-2699f4fb-7f44-410c-8de3-3479005baaaa service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-changed-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-53216f39-f3da-470e-90ae-d1babf4d043b req-2699f4fb-7f44-410c-8de3-3479005baaaa service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Refreshing instance network info cache due to event network-changed-3b90af5a-ae8d-4876-bda9-002751948bb0. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-53216f39-f3da-470e-90ae-d1babf4d043b req-2699f4fb-7f44-410c-8de3-3479005baaaa service nova] Acquiring lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-53216f39-f3da-470e-90ae-d1babf4d043b req-2699f4fb-7f44-410c-8de3-3479005baaaa service nova] Acquired lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG nova.network.neutron [req-53216f39-f3da-470e-90ae-d1babf4d043b req-2699f4fb-7f44-410c-8de3-3479005baaaa service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Refreshing network info cache for port 3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG nova.objects.instance [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'flavor' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:56 user nova-compute[71364]: INFO nova.compute.manager [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Attaching volume e912cde0-b812-4fb1-a157-b47135188efa to /dev/vdb
Apr 11 22:04:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-c9f70cca-72c0-434f-a851-8fbd5fc10bf3 req-7237441d-2291-4fee-aed3-2fe2b5449d9f service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c9f70cca-72c0-434f-a851-8fbd5fc10bf3 req-7237441d-2291-4fee-aed3-2fe2b5449d9f service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c9f70cca-72c0-434f-a851-8fbd5fc10bf3 req-7237441d-2291-4fee-aed3-2fe2b5449d9f service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c9f70cca-72c0-434f-a851-8fbd5fc10bf3 req-7237441d-2291-4fee-aed3-2fe2b5449d9f service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-c9f70cca-72c0-434f-a851-8fbd5fc10bf3 req-7237441d-2291-4fee-aed3-2fe2b5449d9f service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:04:56 user nova-compute[71364]: WARNING nova.compute.manager [req-c9f70cca-72c0-434f-a851-8fbd5fc10bf3 req-7237441d-2291-4fee-aed3-2fe2b5449d9f service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state stopped and task_state powering-on.
Apr 11 22:04:56 user nova-compute[71364]: DEBUG os_brick.utils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40eb943-e75f-4a32-848e-13c0700cc024]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG nova.network.neutron [req-53216f39-f3da-470e-90ae-d1babf4d043b req-2699f4fb-7f44-410c-8de3-3479005baaaa service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Updated VIF entry in instance network info cache for port 3b90af5a-ae8d-4876-bda9-002751948bb0. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG nova.network.neutron [req-53216f39-f3da-470e-90ae-d1babf4d043b req-2699f4fb-7f44-410c-8de3-3479005baaaa service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Updating instance_info_cache with network_info: [{"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[af710ce7-1e33-48eb-8d98-f8a2582b8b2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-53216f39-f3da-470e-90ae-d1babf4d043b req-2699f4fb-7f44-410c-8de3-3479005baaaa service nova] Releasing lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1c4808-fcdf-4fb1-9db8-f98e2c3efd52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[014eee52-e7fa-41be-9bfc-1a44f50965ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:04:56 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1203dc-726e-4ae1-a987-68dbeb1ae0be]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG os_brick.utils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Updating existing volume attachment record: 386de817-b2fe-4dd7-8f6c-f1b09cbff78c {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-d7920a09-dcea-47c2-b1f7-380328e7a037 req-198e6c6c-bb60-4d2c-bbd8-ca2f5a1bdce7 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Received event network-changed-dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-d7920a09-dcea-47c2-b1f7-380328e7a037 req-198e6c6c-bb60-4d2c-bbd8-ca2f5a1bdce7 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Refreshing instance network info cache due to event network-changed-dfc2024c-6b00-43d9-99e4-701ec0227c59. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d7920a09-dcea-47c2-b1f7-380328e7a037 req-198e6c6c-bb60-4d2c-bbd8-ca2f5a1bdce7 service nova] Acquiring lock "refresh_cache-e3cabf27-6d08-41f3-9f09-fa11b614f1d0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d7920a09-dcea-47c2-b1f7-380328e7a037 req-198e6c6c-bb60-4d2c-bbd8-ca2f5a1bdce7 service nova] Acquired lock "refresh_cache-e3cabf27-6d08-41f3-9f09-fa11b614f1d0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG nova.network.neutron [req-d7920a09-dcea-47c2-b1f7-380328e7a037 req-198e6c6c-bb60-4d2c-bbd8-ca2f5a1bdce7 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Refreshing network info cache for port dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:57 user nova-compute[71364]: DEBUG nova.network.neutron [req-d7920a09-dcea-47c2-b1f7-380328e7a037 req-198e6c6c-bb60-4d2c-bbd8-ca2f5a1bdce7 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Updated VIF entry in instance network info cache for port dfc2024c-6b00-43d9-99e4-701ec0227c59. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:04:57 user nova-compute[71364]: DEBUG nova.network.neutron [req-d7920a09-dcea-47c2-b1f7-380328e7a037 req-198e6c6c-bb60-4d2c-bbd8-ca2f5a1bdce7 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Updating instance_info_cache with network_info: [{"id": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "address": "fa:16:3e:df:cc:37", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc2024c-6b", "ovs_interfaceid": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:04:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d7920a09-dcea-47c2-b1f7-380328e7a037 req-198e6c6c-bb60-4d2c-bbd8-ca2f5a1bdce7 service nova] Releasing lock "refresh_cache-e3cabf27-6d08-41f3-9f09-fa11b614f1d0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'flavor' on Instance uuid e3cabf27-6d08-41f3-9f09-fa11b614f1d0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250698.5772612, 53530e4f-a899-496d-8b83-a3b5f7dbc7ea => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:04:58 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] VM Resumed (Lifecycle Event)
Apr 11 22:04:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:04:58 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Instance rebooted successfully.
Apr 11 22:04:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:58 user nova-compute[71364]: INFO nova.compute.manager [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Attaching volume db6fc80f-4287-44b3-886d-c77a82388045 to /dev/vdb
Apr 11 22:04:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:04:58 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 11 22:04:58 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250698.57755, 53530e4f-a899-496d-8b83-a3b5f7dbc7ea => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:04:58 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] VM Started (Lifecycle Event)
Apr 11 22:04:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG nova.compute.manager [req-b8ba654c-0982-489c-b839-4a80513029d9 req-7eb58aaa-16f8-4161-b378-194ae2626e8d service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b8ba654c-0982-489c-b839-4a80513029d9 req-7eb58aaa-16f8-4161-b378-194ae2626e8d service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b8ba654c-0982-489c-b839-4a80513029d9 req-7eb58aaa-16f8-4161-b378-194ae2626e8d service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b8ba654c-0982-489c-b839-4a80513029d9 req-7eb58aaa-16f8-4161-b378-194ae2626e8d service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG nova.compute.manager [req-b8ba654c-0982-489c-b839-4a80513029d9 req-7eb58aaa-16f8-4161-b378-194ae2626e8d service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:04:58 user nova-compute[71364]: WARNING nova.compute.manager [req-b8ba654c-0982-489c-b839-4a80513029d9 req-7eb58aaa-16f8-4161-b378-194ae2626e8d service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state stopped and task_state powering-on.
Apr 11 22:04:58 user nova-compute[71364]: DEBUG os_brick.utils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f9e91a-ec82-45f9-b86f-6ffbcbb2424b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a279aac7-d979-4e6b-9327-f0a82275615c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adaccf4-7cb1-4e5f-9b92-1d044f3361ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5155a327-1568-44d5-b636-955f0a9d24f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:04:58 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:04:58 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c9a31a-c217-4c02-b189-492f56661138]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG os_brick.utils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:04:58 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Updating existing volume attachment record: 4c11c0d6-024b-48f2-88e6-72315ce9d7be {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:04:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwvQMABj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:05:01 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:05:01 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:05:01 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e549ef-e2c5-48e2-8ec5-bf1cf5873224]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:05:01 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efb8ab1-1231-4d8a-894c-b16943fc4dd8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa] added
Apr 11 22:05:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4aa8451-ba50-4400-bc7d-dc4d5f215955]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41a7c46-3b98-4422-aa53-d4bccabb6e81]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwvQMABj {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EwvQMABj" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d9c773-ced1-478c-952b-07ed8947f966]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EwvQMABj'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b58e5a8-308a-442f-8499-7c7ac7f4cd76]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[da22e9db-5b52-410e-aa96-81e775818947]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e74c46e-f7a5-4baa-9cbf-445d6e6424d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa, portal: 172.16.0.220,3260]
Apr 11 22:05:01 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa, portal: 172.16.0.220,3260] successful.
Apr 11 22:05:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.057s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[237b0593-0c06-46e7-ad55-4ec0283bbf13]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5847b9a5-8cfc-47dc-8fd2-a2649451b5dd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:01 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:01 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[015a7fc7-ef14-4098-890a-a2cb1c9e58b7]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwvQMABj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.664s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:05:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] <== connect_volume: return (1666ms) {'type': 'block', 'scsi_wwn': '23034343336393961', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:05:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034343336393961', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:05:02 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:05:02 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:05:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7770MB free_disk=26.094173431396484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:05:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:02 user nova-compute[71364]: DEBUG nova.objects.instance [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'flavor' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:05:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 22:05:02 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:05:02 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:05:02 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:05:02 user nova-compute[71364]:   <serial>e912cde0-b812-4fb1-a157-b47135188efa</serial>
Apr 11 22:05:02 user nova-compute[71364]: </disk>
Apr 11 22:05:02 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5366a438-0f96-4ae2-8c99-48f98501baa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d6268190-2187-4596-9f0b-026c520e5c67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b485c9c2-8fb4-4690-af26-ddfae00d5024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPZyDWxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:05:03 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:05:03 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:05:03 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d25d79b-7465-4854-8efa-5e43de0bcf88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:05:03 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b8c8a8-6f9c-4b85-8098-85df70c5085d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045] added
Apr 11 22:05:03 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e58731-fa0d-46fc-be9d-c34d07c1009b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a287222b-6647-4608-8786-b6512c627dfa]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPZyDWxA {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vPZyDWxA" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb62ab68-8dc8-4338-aa4e-3ec81dda9688]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vPZyDWxA'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No VIF found with MAC fa:16:3e:38:4c:82, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aa552f-e3bb-4a3b-87af-790c6fae4fbe]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d37def-6b9c-4376-8d27-f12e11a76ff6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:03 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:03 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:03 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:03 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[add26d5a-b3e5-498e-adde-1f70bbb1c46b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045, portal: 172.16.0.220,3260]
Apr 11 22:05:03 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045, portal: 172.16.0.220,3260] successful.
Apr 11 22:05:03 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.957s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f7c528-d67e-4c84-9797-c78f68bd6f5a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90cd419-17e0-4241-91a1-89c1fc9df60b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:03 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:03 user nova-compute[71364]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 (non-flash)
Apr 11 22:05:03 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:03 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:03 user nova-compute[71364]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 (non-flash)
Apr 11 22:05:03 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f40a4c-b347-47e2-8656-a4ae96e966af]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:05:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPZyDWxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:04 user nova-compute[71364]: INFO nova.compute.manager [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Rescuing
Apr 11 22:05:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquired lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23932353239316562', 'path': '/dev/sdd'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23932353239316562', 'path': '/dev/sdd'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'flavor' on Instance uuid e3cabf27-6d08-41f3-9f09-fa11b614f1d0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 22:05:04 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:05:04 user nova-compute[71364]:   <source dev="/dev/sdd"/>
Apr 11 22:05:04 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:05:04 user nova-compute[71364]:   <serial>db6fc80f-4287-44b3-886d-c77a82388045</serial>
Apr 11 22:05:04 user nova-compute[71364]: </disk>
Apr 11 22:05:04 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Updating instance_info_cache with network_info: [{"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:05:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Releasing lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Updating instance_info_cache with network_info: [{"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No VIF found with MAC fa:16:3e:df:cc:37, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.574s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-fd3b53d5-3b81-4788-ad40-2a05cfa9bb9a req-afc923fe-5b4f-476d-8abb-1460374f10e7 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-vif-unplugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fd3b53d5-3b81-4788-ad40-2a05cfa9bb9a req-afc923fe-5b4f-476d-8abb-1460374f10e7 service nova] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fd3b53d5-3b81-4788-ad40-2a05cfa9bb9a req-afc923fe-5b4f-476d-8abb-1460374f10e7 service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fd3b53d5-3b81-4788-ad40-2a05cfa9bb9a req-afc923fe-5b4f-476d-8abb-1460374f10e7 service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-fd3b53d5-3b81-4788-ad40-2a05cfa9bb9a req-afc923fe-5b4f-476d-8abb-1460374f10e7 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] No waiting events found dispatching network-vif-unplugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:05:05 user nova-compute[71364]: WARNING nova.compute.manager [req-fd3b53d5-3b81-4788-ad40-2a05cfa9bb9a req-afc923fe-5b4f-476d-8abb-1460374f10e7 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received unexpected event network-vif-unplugged-3b90af5a-ae8d-4876-bda9-002751948bb0 for instance with vm_state active and task_state rescuing.
Apr 11 22:05:05 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Instance destroyed successfully.
Apr 11 22:05:05 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Attempting rescue
Apr 11 22:05:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71364) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Instance directory exists: not creating {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 22:05:05 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Creating image(s)
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "/opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "/opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "/opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'trusted_certs' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk.rescue {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk.rescue" returned: 0 in 0.047s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'migration_context' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Start _get_guest_xml network_info=[{"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "vif_mac": "fa:16:3e:38:4c:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'resources' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'numa_topology' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:05:06 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:05:06 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'vcpu_model' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1950121008',display_name='tempest-ServerRescueNegativeTestJSON-server-1950121008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1950121008',id=29,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1rI3/ko2FizEbaKBgYZ6vNc2Qja+cKtbUN+7VeXaafSg+Iq4uwb7LY1gcxR2uaqZyccMuV4smpseEyWhf4dx7LAxvozpzLvmsuld7AJptCsX+pJs1Gi+3Tk2oYbYYwHA==',key_name='tempest-keypair-337352633',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:03:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c35707743988462887127e06825cd483',ramdisk_id='',reservation_id='r-9ala1i8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-797099247',owner_user_name='tempest-ServerRescueNegativeTestJSON-797099247-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='546f0a94a2ad450ead596252c786839e',uuid=b485c9c2-8fb4-4690-af26-ddfae00d5024,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "vif_mac": "fa:16:3e:38:4c:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converting VIF {"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "vif_mac": "fa:16:3e:38:4c:82"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:4c:82,bridge_name='br-int',has_traffic_filtering=True,id=3b90af5a-ae8d-4876-bda9-002751948bb0,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b90af5a-ae') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'pci_devices' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:05:06 user nova-compute[71364]:   <uuid>b485c9c2-8fb4-4690-af26-ddfae00d5024</uuid>
Apr 11 22:05:06 user nova-compute[71364]:   <name>instance-0000001d</name>
Apr 11 22:05:06 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:05:06 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:05:06 user nova-compute[71364]:   <metadata>
Apr 11 22:05:06 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:05:06 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:05:06 user nova-compute[71364]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1950121008</nova:name>
Apr 11 22:05:06 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:05:06</nova:creationTime>
Apr 11 22:05:06 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:05:06 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:05:06 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:05:06 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:05:06 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:05:06 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:05:06 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:05:06 user nova-compute[71364]:       <nova:owner>
Apr 11 22:05:06 user nova-compute[71364]:         <nova:user uuid="546f0a94a2ad450ead596252c786839e">tempest-ServerRescueNegativeTestJSON-797099247-project-member</nova:user>
Apr 11 22:05:06 user nova-compute[71364]:         <nova:project uuid="c35707743988462887127e06825cd483">tempest-ServerRescueNegativeTestJSON-797099247</nova:project>
Apr 11 22:05:06 user nova-compute[71364]:       </nova:owner>
Apr 11 22:05:06 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:05:06 user nova-compute[71364]:       <nova:ports>
Apr 11 22:05:06 user nova-compute[71364]:         <nova:port uuid="3b90af5a-ae8d-4876-bda9-002751948bb0">
Apr 11 22:05:06 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 22:05:06 user nova-compute[71364]:         </nova:port>
Apr 11 22:05:06 user nova-compute[71364]:       </nova:ports>
Apr 11 22:05:06 user nova-compute[71364]:     </nova:instance>
Apr 11 22:05:06 user nova-compute[71364]:   </metadata>
Apr 11 22:05:06 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:05:06 user nova-compute[71364]:     <system>
Apr 11 22:05:06 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:05:06 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:05:06 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:05:06 user nova-compute[71364]:       <entry name="serial">b485c9c2-8fb4-4690-af26-ddfae00d5024</entry>
Apr 11 22:05:06 user nova-compute[71364]:       <entry name="uuid">b485c9c2-8fb4-4690-af26-ddfae00d5024</entry>
Apr 11 22:05:06 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:05:06 user nova-compute[71364]:     </system>
Apr 11 22:05:06 user nova-compute[71364]:   </sysinfo>
Apr 11 22:05:06 user nova-compute[71364]:   <os>
Apr 11 22:05:06 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:05:06 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:05:06 user nova-compute[71364]:   </os>
Apr 11 22:05:06 user nova-compute[71364]:   <features>
Apr 11 22:05:06 user nova-compute[71364]:     <acpi/>
Apr 11 22:05:06 user nova-compute[71364]:     <apic/>
Apr 11 22:05:06 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:05:06 user nova-compute[71364]:   </features>
Apr 11 22:05:06 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:05:06 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:05:06 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:05:06 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:05:06 user nova-compute[71364]:   </clock>
Apr 11 22:05:06 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:05:06 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:05:06 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:05:06 user nova-compute[71364]:   </cpu>
Apr 11 22:05:06 user nova-compute[71364]:   <devices>
Apr 11 22:05:06 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:05:06 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:05:06 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk.rescue"/>
Apr 11 22:05:06 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:05:06 user nova-compute[71364]:     </disk>
Apr 11 22:05:06 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:05:06 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:05:06 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk"/>
Apr 11 22:05:06 user nova-compute[71364]:       <target dev="vdb" bus="virtio"/>
Apr 11 22:05:06 user nova-compute[71364]:     </disk>
Apr 11 22:05:06 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:05:06 user nova-compute[71364]:       <mac address="fa:16:3e:38:4c:82"/>
Apr 11 22:05:06 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:05:06 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:05:06 user nova-compute[71364]:       <target dev="tap3b90af5a-ae"/>
Apr 11 22:05:06 user nova-compute[71364]:     </interface>
Apr 11 22:05:06 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:05:06 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/console.log" append="off"/>
Apr 11 22:05:06 user nova-compute[71364]:     </serial>
Apr 11 22:05:06 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:05:06 user nova-compute[71364]:     <video>
Apr 11 22:05:06 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:05:06 user nova-compute[71364]:     </video>
Apr 11 22:05:06 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:05:06 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:05:06 user nova-compute[71364]:     </rng>
Apr 11 22:05:06 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:05:06 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:05:06 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:05:06 user nova-compute[71364]:     </memballoon>
Apr 11 22:05:06 user nova-compute[71364]:   </devices>
Apr 11 22:05:06 user nova-compute[71364]: </domain>
Apr 11 22:05:06 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:05:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Instance destroyed successfully.
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] No VIF found with MAC fa:16:3e:38:4c:82, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:06 user nova-compute[71364]: INFO nova.compute.manager [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Detaching volume db6fc80f-4287-44b3-886d-c77a82388045
Apr 11 22:05:06 user nova-compute[71364]: INFO nova.virt.block_device [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Attempting to driver detach volume db6fc80f-4287-44b3-886d-c77a82388045 from mountpoint /dev/vdb
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Attempting to detach device vdb from instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:05:06 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:05:06 user nova-compute[71364]:   <source dev="/dev/sdd"/>
Apr 11 22:05:06 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:05:06 user nova-compute[71364]:   <serial>db6fc80f-4287-44b3-886d-c77a82388045</serial>
Apr 11 22:05:06 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:05:06 user nova-compute[71364]: </disk>
Apr 11 22:05:06 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:05:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Successfully detached device vdb from instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 from the persistent domain config.
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:05:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:05:06 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:05:06 user nova-compute[71364]:   <source dev="/dev/sdd"/>
Apr 11 22:05:06 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:05:06 user nova-compute[71364]:   <serial>db6fc80f-4287-44b3-886d-c77a82388045</serial>
Apr 11 22:05:06 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:05:06 user nova-compute[71364]: </disk>
Apr 11 22:05:06 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-9a5b9b6b-8b79-4ef0-a7cc-f5f58bc8f6ff req-a48b898f-4d02-47bd-859a-25f606eadef8 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9a5b9b6b-8b79-4ef0-a7cc-f5f58bc8f6ff req-a48b898f-4d02-47bd-859a-25f606eadef8 service nova] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9a5b9b6b-8b79-4ef0-a7cc-f5f58bc8f6ff req-a48b898f-4d02-47bd-859a-25f606eadef8 service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9a5b9b6b-8b79-4ef0-a7cc-f5f58bc8f6ff req-a48b898f-4d02-47bd-859a-25f606eadef8 service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-9a5b9b6b-8b79-4ef0-a7cc-f5f58bc8f6ff req-a48b898f-4d02-47bd-859a-25f606eadef8 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] No waiting events found dispatching network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:05:07 user nova-compute[71364]: WARNING nova.compute.manager [req-9a5b9b6b-8b79-4ef0-a7cc-f5f58bc8f6ff req-a48b898f-4d02-47bd-859a-25f606eadef8 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received unexpected event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 for instance with vm_state active and task_state rescuing.
Apr 11 22:05:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681250707.5094945, e3cabf27-6d08-41f3-9f09-fa11b614f1d0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:05:07 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Successfully detached device vdb from instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 from the live domain config.
Apr 11 22:05:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vPZyDWxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:05:07 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48912a9-9590-44e3-bd54-1dcfd19ece40]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:05:07 user nova-compute[71364]: No targets found.
Apr 11 22:05:07 user nova-compute[71364]: iSNS:
Apr 11 22:05:07 user nova-compute[71364]: No targets found.
Apr 11 22:05:07 user nova-compute[71364]: STATIC:
Apr 11 22:05:07 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:05:07 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:05:07 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:05:07 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa
Apr 11 22:05:07 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:05:07 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:05:07 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045
Apr 11 22:05:07 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:05:07 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:05:07 user nova-compute[71364]: FIRMWARE:
Apr 11 22:05:07 user nova-compute[71364]: No targets found.
Apr 11 22:05:07 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:05:07 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:05:07 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d826d464-3cd0-4195-a614-54a2954a1014]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f656709-6519-4c6d-8cf8-8fdd9f13f1fb]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:07 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:07 user nova-compute[71364]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 (non-flash)
Apr 11 22:05:07 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:07 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:07 user nova-compute[71364]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 (non-flash)
Apr 11 22:05:07 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacfc5870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045'): ({'sdd'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Removing single pathed devices sdd {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bb3597-96d3-49bd-af9b-a46d6f474b0e]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[002de349-0ebc-4e39-af01-1050b6a78c92]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flushing IO for device /dev/sdd {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b810fc4-e0c1-4513-a65c-6e59dfb5ba92]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c46cb76-233e-443d-837d-b67c327b85e2]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bd8b26-24cf-4b1c-8bbb-82085148f366]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffbf0ef-4b77-47fd-bf69-086c82bc6aee]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045, portal: 172.16.0.220,3260]
Apr 11 22:05:07 user nova-compute[71364]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045, portal: 172.16.0.220,3260] successful.
Apr 11 22:05:07 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db6fc80f-4287-44b3-886d-c77a82388045 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b5b016-8c66-4750-9b33-433eff91357d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] <== disconnect_volume: return (296ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:08 user nova-compute[71364]: DEBUG nova.objects.instance [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'flavor' on Instance uuid e3cabf27-6d08-41f3-9f09-fa11b614f1d0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:05:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.971s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:05:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] No waiting events found dispatching network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:05:09 user nova-compute[71364]: WARNING nova.compute.manager [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received unexpected event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 for instance with vm_state active and task_state rescuing.
Apr 11 22:05:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:05:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] No waiting events found dispatching network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:05:09 user nova-compute[71364]: WARNING nova.compute.manager [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received unexpected event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 for instance with vm_state active and task_state rescuing.
Apr 11 22:05:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for b485c9c2-8fb4-4690-af26-ddfae00d5024 due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 22:05:10 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250710.070695, b485c9c2-8fb4-4690-af26-ddfae00d5024 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:05:10 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] VM Resumed (Lifecycle Event)
Apr 11 22:05:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:05:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:05:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:05:10 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 22:05:10 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250710.073959, b485c9c2-8fb4-4690-af26-ddfae00d5024 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:05:10 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] VM Started (Lifecycle Event)
Apr 11 22:05:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:05:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:05:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:32 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'flavor' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:33 user nova-compute[71364]: INFO nova.compute.manager [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Attaching volume f1f99201-e0a7-47b6-b229-6add50214f2d to /dev/vdb
Apr 11 22:05:33 user nova-compute[71364]: DEBUG os_brick.utils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4476026-04d7-45d3-be37-b64c415fd3b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0955c76-bd2b-4e25-851f-2d1db4aecc45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36cfdd2-a01e-415a-bc66-4ed1a0a3a268]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0826fcc9-d3c9-4bbf-9196-ac1aafc3832c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:05:33 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:05:33 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b69470-02d0-4a36-9e9e-8144a60e5257]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG os_brick.utils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:05:33 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Updating existing volume attachment record: 39d1422e-8272-42f8-8a10-4b4baf83f88d {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:05:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThFZMXGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:05:39 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:05:39 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.094s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:05:39 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260" returned: 21 in 0.074s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c1449a-ecf5-4772-bcbf-40f1fb7ce212]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:05:39 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.242s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb33ca7-039f-4e5b-b6d4-54155c750e7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d] added
Apr 11 22:05:39 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2718fa72-dff6-40bc-9a35-59fc162ade9f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a67057-959a-41c2-a774-2a6496d72eb2]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThFZMXGv {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThFZMXGv" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d710f66a-ff4a-4031-9315-e9f6ad6292e6]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ThFZMXGv'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d40b006-dd14-464a-bc3e-a73032a2419e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce27cb2-f5a3-4916-8088-415afb914089]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f974723-bea6-4d2c-a758-86cff6a5cbf7 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:39 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:39 user nova-compute[71364]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f974723-bea6-4d2c-a758-86cff6a5cbf7 (non-flash)
Apr 11 22:05:39 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:39 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:39 user nova-compute[71364]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f974723-bea6-4d2c-a758-86cff6a5cbf7 (non-flash)
Apr 11 22:05:39 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7addd66-48ce-438a-a58d-6fa23efbc761]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d, portal: 172.16.0.220,3260]
Apr 11 22:05:39 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d, portal: 172.16.0.220,3260] successful.
Apr 11 22:05:39 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa77c5f-afb4-4fa7-9fd5-6a003b84706a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4545c4-3e91-40d8-9c50-0c09bb5bf0c2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f974723-bea6-4d2c-a758-86cff6a5cbf7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:39 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:39 user nova-compute[71364]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f974723-bea6-4d2c-a758-86cff6a5cbf7 (non-flash)
Apr 11 22:05:39 user nova-compute[71364]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d (non-flash)
Apr 11 22:05:39 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:39 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:39 user nova-compute[71364]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f974723-bea6-4d2c-a758-86cff6a5cbf7 (non-flash)
Apr 11 22:05:39 user nova-compute[71364]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d (non-flash)
Apr 11 22:05:39 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.618s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:05:39 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 1.366s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:41 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2703d39-6e55-48b0-be5f-a90ce440594b]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:41 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:05:41 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThFZMXGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:05:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.129s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:05:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] <== connect_volume: return (3133ms) {'type': 'block', 'scsi_wwn': '23436656561336336', 'path': '/dev/sde'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:05:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436656561336336', 'path': '/dev/sde'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:05:42 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'flavor' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:05:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 22:05:42 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:05:42 user nova-compute[71364]:   <source dev="/dev/sde"/>
Apr 11 22:05:42 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:05:42 user nova-compute[71364]:   <serial>f1f99201-e0a7-47b6-b229-6add50214f2d</serial>
Apr 11 22:05:42 user nova-compute[71364]: </disk>
Apr 11 22:05:42 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 22:05:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:05:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:05:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] No VIF found with MAC fa:16:3e:49:5f:74, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:05:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.726s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:05:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:05:43 user nova-compute[71364]: INFO nova.compute.claims [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Claim successful on node user
Apr 11 22:05:43 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:05:43 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:05:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.738s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:05:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:05:43 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:05:43 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:05:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:05:43 user nova-compute[71364]: INFO nova.virt.block_device [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Booting with volume-backed-image ca576860-9db2-47a8-a5c5-dc172050b182 at /dev/vda
Apr 11 22:05:43 user nova-compute[71364]: DEBUG nova.policy [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:44 user nova-compute[71364]: INFO nova.compute.manager [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Detaching volume f1f99201-e0a7-47b6-b229-6add50214f2d
Apr 11 22:05:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:44 user nova-compute[71364]: INFO nova.virt.block_device [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Attempting to driver detach volume f1f99201-e0a7-47b6-b229-6add50214f2d from mountpoint /dev/vdb
Apr 11 22:05:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Attempting to detach device vdb from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:05:44 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:05:44 user nova-compute[71364]:   <source dev="/dev/sde"/>
Apr 11 22:05:44 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:05:44 user nova-compute[71364]:   <serial>f1f99201-e0a7-47b6-b229-6add50214f2d</serial>
Apr 11 22:05:44 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:05:44 user nova-compute[71364]: </disk>
Apr 11 22:05:44 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:05:44 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Successfully detached device vdb from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the persistent domain config.
Apr 11 22:05:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:05:44 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:05:44 user nova-compute[71364]:   <source dev="/dev/sde"/>
Apr 11 22:05:44 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:05:44 user nova-compute[71364]:   <serial>f1f99201-e0a7-47b6-b229-6add50214f2d</serial>
Apr 11 22:05:44 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:05:44 user nova-compute[71364]: </disk>
Apr 11 22:05:44 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Successfully created port: 0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681250744.927489, 5366a438-0f96-4ae2-8c99-48f98501baa3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:05:44 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Successfully detached device vdb from instance 5366a438-0f96-4ae2-8c99-48f98501baa3 from the live domain config.
Apr 11 22:05:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThFZMXGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:05:44 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:05:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[782b49ba-2b33-4aba-972e-0de249ad2184]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f974723-bea6-4d2c-a758-86cff6a5cbf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:05:44 user nova-compute[71364]: No targets found.
Apr 11 22:05:44 user nova-compute[71364]: iSNS:
Apr 11 22:05:44 user nova-compute[71364]: No targets found.
Apr 11 22:05:44 user nova-compute[71364]: STATIC:
Apr 11 22:05:44 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:05:44 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:05:44 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:05:44 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d
Apr 11 22:05:44 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:05:44 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:05:44 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa
Apr 11 22:05:44 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:05:44 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:05:44 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:5f974723-bea6-4d2c-a758-86cff6a5cbf7
Apr 11 22:05:44 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:05:44 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:05:44 user nova-compute[71364]: FIRMWARE:
Apr 11 22:05:44 user nova-compute[71364]: No targets found.
Apr 11 22:05:44 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:05:44 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:05:44 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9a8188-04f2-452d-bfd0-c40a6545a186]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f974723-bea6-4d2c-a758-86cff6a5cbf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6101bca-6391-450d-89fe-1f4cf077329c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f974723-bea6-4d2c-a758-86cff6a5cbf7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:45 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:45 user nova-compute[71364]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f974723-bea6-4d2c-a758-86cff6a5cbf7 (non-flash)
Apr 11 22:05:45 user nova-compute[71364]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d (non-flash)
Apr 11 22:05:45 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:45 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:45 user nova-compute[71364]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f974723-bea6-4d2c-a758-86cff6a5cbf7 (non-flash)
Apr 11 22:05:45 user nova-compute[71364]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d (non-flash)
Apr 11 22:05:45 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bf00e9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d'): ({'sde'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Removing single pathed devices sde {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8905d2-d79a-4e83-84e6-cb5807973177]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a3211e-45ea-4659-a1db-fbc14abdf0da]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Flushing IO for device /dev/sde {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dbc62d-f215-433b-9bc3-d17152e881e3]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0faad7-ee67-4edc-baaf-72c67318269e]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[54686d08-7378-4b42-b53c-3da00f194a17]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c7576d-e325-41e9-a03c-06d8456b648b]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d, portal: 172.16.0.220,3260]
Apr 11 22:05:45 user nova-compute[71364]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d, portal: 172.16.0.220,3260] successful.
Apr 11 22:05:45 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1f99201-e0a7-47b6-b229-6add50214f2d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7682a813-0044-4ca2-9228-8499e8b48e20]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] <== disconnect_volume: return (341ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Successfully updated port: 0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "refresh_cache-3b74e50d-0c81-4c84-a97a-2e22a0524a93" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquired lock "refresh_cache-3b74e50d-0c81-4c84-a97a-2e22a0524a93" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG nova.compute.manager [req-defa4a5c-c683-40cf-9fec-8674faca90ba req-33d1a6a4-460f-4e48-9bf7-b15993ff83df service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-changed-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG nova.compute.manager [req-defa4a5c-c683-40cf-9fec-8674faca90ba req-33d1a6a4-460f-4e48-9bf7-b15993ff83df service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Refreshing instance network info cache due to event network-changed-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-defa4a5c-c683-40cf-9fec-8674faca90ba req-33d1a6a4-460f-4e48-9bf7-b15993ff83df service nova] Acquiring lock "refresh_cache-3b74e50d-0c81-4c84-a97a-2e22a0524a93" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Updating instance_info_cache with network_info: [{"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Releasing lock "refresh_cache-3b74e50d-0c81-4c84-a97a-2e22a0524a93" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Instance network_info: |[{"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-defa4a5c-c683-40cf-9fec-8674faca90ba req-33d1a6a4-460f-4e48-9bf7-b15993ff83df service nova] Acquired lock "refresh_cache-3b74e50d-0c81-4c84-a97a-2e22a0524a93" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:05:45 user nova-compute[71364]: DEBUG nova.network.neutron [req-defa4a5c-c683-40cf-9fec-8674faca90ba req-33d1a6a4-460f-4e48-9bf7-b15993ff83df service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Refreshing network info cache for port 0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:05:46 user nova-compute[71364]: DEBUG nova.objects.instance [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'flavor' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:05:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.998s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:46 user nova-compute[71364]: DEBUG nova.network.neutron [req-defa4a5c-c683-40cf-9fec-8674faca90ba req-33d1a6a4-460f-4e48-9bf7-b15993ff83df service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Updated VIF entry in instance network info cache for port 0f82f3bd-eb56-4b1a-aed6-7b4159cc1852. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:05:46 user nova-compute[71364]: DEBUG nova.network.neutron [req-defa4a5c-c683-40cf-9fec-8674faca90ba req-33d1a6a4-460f-4e48-9bf7-b15993ff83df service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Updating instance_info_cache with network_info: [{"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:05:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-defa4a5c-c683-40cf-9fec-8674faca90ba req-33d1a6a4-460f-4e48-9bf7-b15993ff83df service nova] Releasing lock "refresh_cache-3b74e50d-0c81-4c84-a97a-2e22a0524a93" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:05:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:49 user nova-compute[71364]: DEBUG os_brick.utils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:05:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.094s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb22ee6-6d41-42a5-8f52-4f5413255261]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a234e343-eb72-4244-9c5c-b5e41586507a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5fb40c-2c97-42b8-a40f-7646e089b76c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2461d7c5-424a-4bf4-ad77-0399db22be93]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:05:50 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:05:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[084ba375-d370-43de-b5ca-1568092ca6d5]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG os_brick.utils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] <== get_connector_properties: return (210ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Updating existing volume attachment record: e61a2e3f-af91-4958-a423-f35d7dbef229 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:05:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:05:54 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Creating image(s)
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Ensure instance console log exists: /opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Start _get_guest_xml network_info=[{"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCxnpyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b74e50d-0c81-4c84-a97a-2e22a0524a93', 'attached_at': '', 'detached_at': '', 'volume_id': '1a70f8fe-561d-4836-b2b4-775fe6e2b4ba', 'serial': '1a70f8fe-561d-4836-b2b4-775fe6e2b4ba'}, 'attachment_id': 'e61a2e3f-af91-4958-a423-f35d7dbef229', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:05:54 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:05:54 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCxnpyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:05:54 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:05:54 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:05:54 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b93ef3-b5d9-41bb-b230-b51d9b846212]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:05:54 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd41f3f-32b2-410e-8a62-416342418c5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba] added
Apr 11 22:05:54 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a565b69b-57c8-4400-befd-9aa200715b9f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aaec30-30d2-4558-9f70-7ca19928fb24]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCxnpyJT {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCxnpyJT" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67e218f-2cb8-44e9-912d-42776e1e5352]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dCxnpyJT'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83549b5-e380-44ca-af22-a28d50609095]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39000ad-5770-41c3-9b8e-af766474029a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:54 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:54 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:54 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:54 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --login" returned: 0 in 0.131s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bca49e2-b383-4283-bd0f-e7d0285e46b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba, portal: 172.16.0.220,3260]
Apr 11 22:05:54 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba, portal: 172.16.0.220,3260] successful.
Apr 11 22:05:54 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.064s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[677ff642-97af-4f0d-8d30-ed21284afcce]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d190a3a-d184-4150-bb01-3c1530831d7f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:54 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:54 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:05:54 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:05:54 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:05:54 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:05:54 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7594e7a-6055-4ccf-9d57-503cdb5fe9ea]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:05:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCxnpyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '23365356339626531', 'path': '/dev/sdd'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365356339626531', 'path': '/dev/sdd'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-681651975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-681651975',id=32,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53057a8fc17e400e8c26a7dec2c873f9',ramdisk_id='',reservation_id='r-7bjmu0w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:05:44Z,user_data=None,user_id='10430313a8b44e6794ca88d30a83c69a',uuid=3b74e50d-0c81-4c84-a97a-2e22a0524a93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converting VIF {"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:74:fd,bridge_name='br-int',has_traffic_filtering=True,id=0f82f3bd-eb56-4b1a-aed6-7b4159cc1852,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f82f3bd-eb') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG nova.objects.instance [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b74e50d-0c81-4c84-a97a-2e22a0524a93 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:05:55 user nova-compute[71364]:   <uuid>3b74e50d-0c81-4c84-a97a-2e22a0524a93</uuid>
Apr 11 22:05:55 user nova-compute[71364]:   <name>instance-00000020</name>
Apr 11 22:05:55 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:05:55 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:05:55 user nova-compute[71364]:   <metadata>
Apr 11 22:05:55 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:05:55 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:05:55 user nova-compute[71364]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-681651975</nova:name>
Apr 11 22:05:55 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:05:54</nova:creationTime>
Apr 11 22:05:55 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:05:55 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:05:55 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:05:55 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:05:55 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:05:55 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:05:55 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:05:55 user nova-compute[71364]:       <nova:owner>
Apr 11 22:05:55 user nova-compute[71364]:         <nova:user uuid="10430313a8b44e6794ca88d30a83c69a">tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member</nova:user>
Apr 11 22:05:55 user nova-compute[71364]:         <nova:project uuid="53057a8fc17e400e8c26a7dec2c873f9">tempest-ServerBootFromVolumeStableRescueTest-1235920472</nova:project>
Apr 11 22:05:55 user nova-compute[71364]:       </nova:owner>
Apr 11 22:05:55 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:05:55 user nova-compute[71364]:       <nova:ports>
Apr 11 22:05:55 user nova-compute[71364]:         <nova:port uuid="0f82f3bd-eb56-4b1a-aed6-7b4159cc1852">
Apr 11 22:05:55 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 22:05:55 user nova-compute[71364]:         </nova:port>
Apr 11 22:05:55 user nova-compute[71364]:       </nova:ports>
Apr 11 22:05:55 user nova-compute[71364]:     </nova:instance>
Apr 11 22:05:55 user nova-compute[71364]:   </metadata>
Apr 11 22:05:55 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:05:55 user nova-compute[71364]:     <system>
Apr 11 22:05:55 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:05:55 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:05:55 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:05:55 user nova-compute[71364]:       <entry name="serial">3b74e50d-0c81-4c84-a97a-2e22a0524a93</entry>
Apr 11 22:05:55 user nova-compute[71364]:       <entry name="uuid">3b74e50d-0c81-4c84-a97a-2e22a0524a93</entry>
Apr 11 22:05:55 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:05:55 user nova-compute[71364]:     </system>
Apr 11 22:05:55 user nova-compute[71364]:   </sysinfo>
Apr 11 22:05:55 user nova-compute[71364]:   <os>
Apr 11 22:05:55 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:05:55 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:05:55 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:05:55 user nova-compute[71364]:   </os>
Apr 11 22:05:55 user nova-compute[71364]:   <features>
Apr 11 22:05:55 user nova-compute[71364]:     <acpi/>
Apr 11 22:05:55 user nova-compute[71364]:     <apic/>
Apr 11 22:05:55 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:05:55 user nova-compute[71364]:   </features>
Apr 11 22:05:55 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:05:55 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:05:55 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:05:55 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:05:55 user nova-compute[71364]:   </clock>
Apr 11 22:05:55 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:05:55 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:05:55 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:05:55 user nova-compute[71364]:   </cpu>
Apr 11 22:05:55 user nova-compute[71364]:   <devices>
Apr 11 22:05:55 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 22:05:55 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:05:55 user nova-compute[71364]:       <source dev="/dev/sdd"/>
Apr 11 22:05:55 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:05:55 user nova-compute[71364]:       <serial>1a70f8fe-561d-4836-b2b4-775fe6e2b4ba</serial>
Apr 11 22:05:55 user nova-compute[71364]:     </disk>
Apr 11 22:05:55 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:05:55 user nova-compute[71364]:       <mac address="fa:16:3e:60:74:fd"/>
Apr 11 22:05:55 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:05:55 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:05:55 user nova-compute[71364]:       <target dev="tap0f82f3bd-eb"/>
Apr 11 22:05:55 user nova-compute[71364]:     </interface>
Apr 11 22:05:55 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:05:55 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/console.log" append="off"/>
Apr 11 22:05:55 user nova-compute[71364]:     </serial>
Apr 11 22:05:55 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:05:55 user nova-compute[71364]:     <video>
Apr 11 22:05:55 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:05:55 user nova-compute[71364]:     </video>
Apr 11 22:05:55 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:05:55 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:05:55 user nova-compute[71364]:     </rng>
Apr 11 22:05:55 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:05:55 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:05:55 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:05:55 user nova-compute[71364]:     </memballoon>
Apr 11 22:05:55 user nova-compute[71364]:   </devices>
Apr 11 22:05:55 user nova-compute[71364]: </domain>
Apr 11 22:05:55 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-681651975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-681651975',id=32,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53057a8fc17e400e8c26a7dec2c873f9',ramdisk_id='',reservation_id='r-7bjmu0w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:05:44Z,user_data=None,user_id='10430313a8b44e6794ca88d30a83c69a',uuid=3b74e50d-0c81-4c84-a97a-2e22a0524a93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converting VIF {"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:74:fd,bridge_name='br-int',has_traffic_filtering=True,id=0f82f3bd-eb56-4b1a-aed6-7b4159cc1852,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f82f3bd-eb') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG os_vif [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:74:fd,bridge_name='br-int',has_traffic_filtering=True,id=0f82f3bd-eb56-4b1a-aed6-7b4159cc1852,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f82f3bd-eb') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f82f3bd-eb, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0f82f3bd-eb, col_values=(('external_ids', {'iface-id': '0f82f3bd-eb56-4b1a-aed6-7b4159cc1852', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:74:fd', 'vm-uuid': '3b74e50d-0c81-4c84-a97a-2e22a0524a93'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:05:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:56 user nova-compute[71364]: INFO os_vif [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:74:fd,bridge_name='br-int',has_traffic_filtering=True,id=0f82f3bd-eb56-4b1a-aed6-7b4159cc1852,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f82f3bd-eb')
Apr 11 22:05:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:05:56 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] No VIF found with MAC fa:16:3e:60:74:fd, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:57 user nova-compute[71364]: INFO nova.compute.manager [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Terminating instance
Apr 11 22:05:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-ffcee87b-0fd6-43bb-8308-c3b5abf85bcc req-90c6046e-3895-45d2-b53c-ebd2dbfcce47 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Received event network-vif-unplugged-dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ffcee87b-0fd6-43bb-8308-c3b5abf85bcc req-90c6046e-3895-45d2-b53c-ebd2dbfcce47 service nova] Acquiring lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ffcee87b-0fd6-43bb-8308-c3b5abf85bcc req-90c6046e-3895-45d2-b53c-ebd2dbfcce47 service nova] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ffcee87b-0fd6-43bb-8308-c3b5abf85bcc req-90c6046e-3895-45d2-b53c-ebd2dbfcce47 service nova] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-ffcee87b-0fd6-43bb-8308-c3b5abf85bcc req-90c6046e-3895-45d2-b53c-ebd2dbfcce47 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] No waiting events found dispatching network-vif-unplugged-dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-ffcee87b-0fd6-43bb-8308-c3b5abf85bcc req-90c6046e-3895-45d2-b53c-ebd2dbfcce47 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Received event network-vif-unplugged-dfc2024c-6b00-43d9-99e4-701ec0227c59 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-1433a89d-55ea-4a7b-b58d-f6c40f4145e7 req-7ff4d2f4-3731-4a13-a9f9-3dbbef1c11df service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1433a89d-55ea-4a7b-b58d-f6c40f4145e7 req-7ff4d2f4-3731-4a13-a9f9-3dbbef1c11df service nova] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1433a89d-55ea-4a7b-b58d-f6c40f4145e7 req-7ff4d2f4-3731-4a13-a9f9-3dbbef1c11df service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1433a89d-55ea-4a7b-b58d-f6c40f4145e7 req-7ff4d2f4-3731-4a13-a9f9-3dbbef1c11df service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-1433a89d-55ea-4a7b-b58d-f6c40f4145e7 req-7ff4d2f4-3731-4a13-a9f9-3dbbef1c11df service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] No waiting events found dispatching network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:05:57 user nova-compute[71364]: WARNING nova.compute.manager [req-1433a89d-55ea-4a7b-b58d-f6c40f4145e7 req-7ff4d2f4-3731-4a13-a9f9-3dbbef1c11df service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received unexpected event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance with vm_state building and task_state spawning.
Apr 11 22:05:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:58 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Instance destroyed successfully.
Apr 11 22:05:58 user nova-compute[71364]: DEBUG nova.objects.instance [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'resources' on Instance uuid e3cabf27-6d08-41f3-9f09-fa11b614f1d0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:05:58 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1426237921',display_name='tempest-AttachVolumeNegativeTest-server-1426237921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1426237921',id=30,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRr4IWLq3T4jHMGPjljW6TmNMH2L69htysqM9Sz2e4uBsfapdGC98UY1R7j8JhRkX/MjbG3HhmM33uG3A5dPhqhyUBaVRQZVg7cZUGNKeEmiqTcFWT48IoKEQKcXarNuA==',key_name='tempest-keypair-1416556452',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:03:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='722a2704f607415ebe42af5ad98bf419',ramdisk_id='',reservation_id='r-npm26r2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2131251711',owner_user_name='tempest-AttachVolumeNegativeTest-2131251711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d615e85afb4354b37e88b5a24429d8',uuid=e3cabf27-6d08-41f3-9f09-fa11b614f1d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "address": "fa:16:3e:df:cc:37", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc2024c-6b", "ovs_interfaceid": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:05:58 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converting VIF {"id": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "address": "fa:16:3e:df:cc:37", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfc2024c-6b", "ovs_interfaceid": "dfc2024c-6b00-43d9-99e4-701ec0227c59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:05:58 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:cc:37,bridge_name='br-int',has_traffic_filtering=True,id=dfc2024c-6b00-43d9-99e4-701ec0227c59,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc2024c-6b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:05:58 user nova-compute[71364]: DEBUG os_vif [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:cc:37,bridge_name='br-int',has_traffic_filtering=True,id=dfc2024c-6b00-43d9-99e4-701ec0227c59,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc2024c-6b') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:05:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfc2024c-6b, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:05:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:05:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:58 user nova-compute[71364]: INFO os_vif [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:cc:37,bridge_name='br-int',has_traffic_filtering=True,id=dfc2024c-6b00-43d9-99e4-701ec0227c59,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfc2024c-6b')
Apr 11 22:05:58 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Deleting instance files /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0_del
Apr 11 22:05:58 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Deletion of /opt/stack/data/nova/instances/e3cabf27-6d08-41f3-9f09-fa11b614f1d0_del complete
Apr 11 22:05:58 user nova-compute[71364]: INFO nova.compute.manager [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 11 22:05:58 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:05:58 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:05:58 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:05:59 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Took 0.96 seconds to deallocate network for instance.
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-b78bc375-120d-4c80-ab70-42f0b350b802 req-4bb15a9f-433d-4ed8-8a12-3b46df357e96 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Received event network-vif-plugged-dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b78bc375-120d-4c80-ab70-42f0b350b802 req-4bb15a9f-433d-4ed8-8a12-3b46df357e96 service nova] Acquiring lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b78bc375-120d-4c80-ab70-42f0b350b802 req-4bb15a9f-433d-4ed8-8a12-3b46df357e96 service nova] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b78bc375-120d-4c80-ab70-42f0b350b802 req-4bb15a9f-433d-4ed8-8a12-3b46df357e96 service nova] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-b78bc375-120d-4c80-ab70-42f0b350b802 req-4bb15a9f-433d-4ed8-8a12-3b46df357e96 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] No waiting events found dispatching network-vif-plugged-dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:05:59 user nova-compute[71364]: WARNING nova.compute.manager [req-b78bc375-120d-4c80-ab70-42f0b350b802 req-4bb15a9f-433d-4ed8-8a12-3b46df357e96 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Received unexpected event network-vif-plugged-dfc2024c-6b00-43d9-99e4-701ec0227c59 for instance with vm_state deleted and task_state None.
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-3ec16ec4-8522-4dfd-8bcd-23036786d16b req-8b8f77b4-d2bf-4c84-b585-612d08dccc36 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3ec16ec4-8522-4dfd-8bcd-23036786d16b req-8b8f77b4-d2bf-4c84-b585-612d08dccc36 service nova] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3ec16ec4-8522-4dfd-8bcd-23036786d16b req-8b8f77b4-d2bf-4c84-b585-612d08dccc36 service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3ec16ec4-8522-4dfd-8bcd-23036786d16b req-8b8f77b4-d2bf-4c84-b585-612d08dccc36 service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-3ec16ec4-8522-4dfd-8bcd-23036786d16b req-8b8f77b4-d2bf-4c84-b585-612d08dccc36 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] No waiting events found dispatching network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:05:59 user nova-compute[71364]: WARNING nova.compute.manager [req-3ec16ec4-8522-4dfd-8bcd-23036786d16b req-8b8f77b4-d2bf-4c84-b585-612d08dccc36 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received unexpected event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance with vm_state building and task_state spawning.
Apr 11 22:05:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-3ec16ec4-8522-4dfd-8bcd-23036786d16b req-8b8f77b4-d2bf-4c84-b585-612d08dccc36 service nova] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Received event network-vif-deleted-dfc2024c-6b00-43d9-99e4-701ec0227c59 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.644s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:05:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:05:59 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Deleted allocations for instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "e3cabf27-6d08-41f3-9f09-fa11b614f1d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.017s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250760.0873675, 3b74e50d-0c81-4c84-a97a-2e22a0524a93 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:06:00 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] VM Resumed (Lifecycle Event)
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:06:00 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Instance spawned successfully.
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:00 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250760.0904734, 3b74e50d-0c81-4c84-a97a-2e22a0524a93 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:06:00 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] VM Started (Lifecycle Event)
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:00 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:06:00 user nova-compute[71364]: INFO nova.compute.manager [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Took 5.81 seconds to spawn the instance on the hypervisor.
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:00 user nova-compute[71364]: INFO nova.compute.manager [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Took 17.36 seconds to build instance.
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.480s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:06:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:02 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:06:02 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7763MB free_disk=26.08282470703125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5366a438-0f96-4ae2-8c99-48f98501baa3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d6268190-2187-4596-9f0b-026c520e5c67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b485c9c2-8fb4-4690-af26-ddfae00d5024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing inventories for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating ProviderTree inventory for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating inventory in ProviderTree for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing aggregate associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, aggregates: None {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 22:06:02 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing trait associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 22:06:03 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:06:03 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:06:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:06:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:03 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:06:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 22:06:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] There are 0 instances to clean {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 22:06:03 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:06:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71364) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Updating instance_info_cache with network_info: [{"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:06:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:06:06 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:06:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:06:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:06:13 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250758.0750146, e3cabf27-6d08-41f3-9f09-fa11b614f1d0 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:06:13 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] VM Stopped (Lifecycle Event)
Apr 11 22:06:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fd19f574-62de-4dbe-acd8-91879a4263a3 None None] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:06:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:14 user nova-compute[71364]: DEBUG nova.compute.manager [req-3ea6f8c8-cbae-4237-8a23-75f731ffa0bd req-faddd4b0-583e-41d4-ad88-625a8207bc3b service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Received event network-changed-184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:14 user nova-compute[71364]: DEBUG nova.compute.manager [req-3ea6f8c8-cbae-4237-8a23-75f731ffa0bd req-faddd4b0-583e-41d4-ad88-625a8207bc3b service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Refreshing instance network info cache due to event network-changed-184fffcb-758c-4ac6-afbd-b3d27a38f374. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:06:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3ea6f8c8-cbae-4237-8a23-75f731ffa0bd req-faddd4b0-583e-41d4-ad88-625a8207bc3b service nova] Acquiring lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:06:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3ea6f8c8-cbae-4237-8a23-75f731ffa0bd req-faddd4b0-583e-41d4-ad88-625a8207bc3b service nova] Acquired lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:06:14 user nova-compute[71364]: DEBUG nova.network.neutron [req-3ea6f8c8-cbae-4237-8a23-75f731ffa0bd req-faddd4b0-583e-41d4-ad88-625a8207bc3b service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Refreshing network info cache for port 184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:06:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:14 user nova-compute[71364]: DEBUG nova.network.neutron [req-3ea6f8c8-cbae-4237-8a23-75f731ffa0bd req-faddd4b0-583e-41d4-ad88-625a8207bc3b service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Updated VIF entry in instance network info cache for port 184fffcb-758c-4ac6-afbd-b3d27a38f374. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:06:14 user nova-compute[71364]: DEBUG nova.network.neutron [req-3ea6f8c8-cbae-4237-8a23-75f731ffa0bd req-faddd4b0-583e-41d4-ad88-625a8207bc3b service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Updating instance_info_cache with network_info: [{"id": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "address": "fa:16:3e:89:4e:e1", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184fffcb-75", "ovs_interfaceid": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:06:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3ea6f8c8-cbae-4237-8a23-75f731ffa0bd req-faddd4b0-583e-41d4-ad88-625a8207bc3b service nova] Releasing lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:06:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:17 user nova-compute[71364]: DEBUG nova.compute.manager [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:06:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:17 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:06:17 user nova-compute[71364]: INFO nova.compute.claims [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Claim successful on node user
Apr 11 22:06:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG nova.network.neutron [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:06:18 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:06:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:06:18 user nova-compute[71364]: INFO nova.virt.block_device [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Booting with volume 68c0a458-6bd5-45d6-b87b-1d992e32f75c at /dev/vda
Apr 11 22:06:18 user nova-compute[71364]: DEBUG nova.policy [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG os_brick.utils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[07467892-806c-47a5-bc95-3452f7e46c6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ca4d2e-e822-4918-bab9-f019e30e9773]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a79897f-2b59-4f5c-b60c-12c6d7ae9cfb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f1673e-2acf-4044-9c31-43556132594a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:06:18 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:06:18 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c86e1f7-f105-47d3-836b-a3f475acec3a]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG os_brick.utils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:06:18 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Updating existing volume attachment record: 5e3644c8-e570-4bfd-ba0d-786cfbeebe0b {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:06:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Successfully created port: b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:06:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Successfully updated port: b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:06:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:06:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquired lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:06:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:06:19 user nova-compute[71364]: DEBUG nova.compute.manager [req-f710883a-206d-441a-93e2-49b0d7b2a1ac req-c184919d-83a0-47f2-b103-b97604af4b0b service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received event network-changed-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:19 user nova-compute[71364]: DEBUG nova.compute.manager [req-f710883a-206d-441a-93e2-49b0d7b2a1ac req-c184919d-83a0-47f2-b103-b97604af4b0b service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Refreshing instance network info cache due to event network-changed-b0b481ae-0b9d-4aac-ad21-f165acd47d15. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:06:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f710883a-206d-441a-93e2-49b0d7b2a1ac req-c184919d-83a0-47f2-b103-b97604af4b0b service nova] Acquiring lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:06:20 user nova-compute[71364]: DEBUG nova.network.neutron [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:06:20 user nova-compute[71364]: DEBUG nova.network.neutron [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Updating instance_info_cache with network_info: [{"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:06:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Releasing lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:06:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Instance network_info: |[{"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:06:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f710883a-206d-441a-93e2-49b0d7b2a1ac req-c184919d-83a0-47f2-b103-b97604af4b0b service nova] Acquired lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:06:20 user nova-compute[71364]: DEBUG nova.network.neutron [req-f710883a-206d-441a-93e2-49b0d7b2a1ac req-c184919d-83a0-47f2-b103-b97604af4b0b service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Refreshing network info cache for port b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:06:21 user nova-compute[71364]: DEBUG nova.network.neutron [req-f710883a-206d-441a-93e2-49b0d7b2a1ac req-c184919d-83a0-47f2-b103-b97604af4b0b service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Updated VIF entry in instance network info cache for port b0b481ae-0b9d-4aac-ad21-f165acd47d15. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:06:21 user nova-compute[71364]: DEBUG nova.network.neutron [req-f710883a-206d-441a-93e2-49b0d7b2a1ac req-c184919d-83a0-47f2-b103-b97604af4b0b service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Updating instance_info_cache with network_info: [{"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:06:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f710883a-206d-441a-93e2-49b0d7b2a1ac req-c184919d-83a0-47f2-b103-b97604af4b0b service nova] Releasing lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:06:23 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Creating image(s)
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Ensure instance console log exists: /opt/stack/data/nova/instances/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Start _get_guest_xml network_info=[{"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuEmJKle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d', 'attached_at': '', 'detached_at': '', 'volume_id': '68c0a458-6bd5-45d6-b87b-1d992e32f75c', 'serial': '68c0a458-6bd5-45d6-b87b-1d992e32f75c'}, 'attachment_id': '5e3644c8-e570-4bfd-ba0d-786cfbeebe0b', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:06:23 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:06:23 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuEmJKle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:06:23 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:06:23 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:06:23 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5df8f4-9ee5-4255-9b38-45d61d93e172]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:06:23 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb520ad-9d68-46de-8533-b64eb8aca34f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c] added
Apr 11 22:06:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c13507-7d0d-41a8-8930-b0b5cb1c5829]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9f8cb9-1e62-4384-b981-361810576edf]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BuEmJKle {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BuEmJKle" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b2b027-932a-4c2d-a2a9-a04de429164e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BuEmJKle'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e365e24-c586-4af1-841f-5780256528d8]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f151826a-f990-4a5c-b334-e5ad2575faf2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:06:23 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:06:23 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:06:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:06:23 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:06:23 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:06:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bd885f-dde7-4df4-b653-93fe62c281f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260]
Apr 11 22:06:23 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260] successful.
Apr 11 22:06:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.054s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7b50cc-93c2-4444-8b0d-ece02ed4f718]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7375cd9-c20a-4103-bb4c-ffe2492acbcc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:06:23 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:06:23 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:06:23 user nova-compute[71364]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:06:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:06:23 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:06:23 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:06:23 user nova-compute[71364]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:06:23 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd2560c-a255-4f5e-aa8f-7e621c2d68ba]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:06:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuEmJKle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23264323531383164', 'path': '/dev/sde'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264323531383164', 'path': '/dev/sde'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1084422016',display_name='tempest-ServerActionsTestJSON-server-1084422016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1084422016',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-3j4bwdo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:06:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:36:11,bridge_name='br-int',has_traffic_filtering=True,id=b0b481ae-0b9d-4aac-ad21-f165acd47d15,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b481ae-0b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG nova.objects.instance [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'pci_devices' on Instance uuid ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:06:24 user nova-compute[71364]:   <uuid>ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d</uuid>
Apr 11 22:06:24 user nova-compute[71364]:   <name>instance-00000021</name>
Apr 11 22:06:24 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:06:24 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:06:24 user nova-compute[71364]:   <metadata>
Apr 11 22:06:24 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:06:24 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:06:24 user nova-compute[71364]:       <nova:name>tempest-ServerActionsTestJSON-server-1084422016</nova:name>
Apr 11 22:06:24 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:06:23</nova:creationTime>
Apr 11 22:06:24 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:06:24 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:06:24 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:06:24 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:06:24 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:06:24 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:06:24 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:06:24 user nova-compute[71364]:       <nova:owner>
Apr 11 22:06:24 user nova-compute[71364]:         <nova:user uuid="939785ef89cb491aae3df4f411b2543d">tempest-ServerActionsTestJSON-434853204-project-member</nova:user>
Apr 11 22:06:24 user nova-compute[71364]:         <nova:project uuid="c9fff7d112a94e7da6bf166a6f628fed">tempest-ServerActionsTestJSON-434853204</nova:project>
Apr 11 22:06:24 user nova-compute[71364]:       </nova:owner>
Apr 11 22:06:24 user nova-compute[71364]:       <nova:ports>
Apr 11 22:06:24 user nova-compute[71364]:         <nova:port uuid="b0b481ae-0b9d-4aac-ad21-f165acd47d15">
Apr 11 22:06:24 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 22:06:24 user nova-compute[71364]:         </nova:port>
Apr 11 22:06:24 user nova-compute[71364]:       </nova:ports>
Apr 11 22:06:24 user nova-compute[71364]:     </nova:instance>
Apr 11 22:06:24 user nova-compute[71364]:   </metadata>
Apr 11 22:06:24 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:06:24 user nova-compute[71364]:     <system>
Apr 11 22:06:24 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:06:24 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:06:24 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:06:24 user nova-compute[71364]:       <entry name="serial">ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d</entry>
Apr 11 22:06:24 user nova-compute[71364]:       <entry name="uuid">ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d</entry>
Apr 11 22:06:24 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:06:24 user nova-compute[71364]:     </system>
Apr 11 22:06:24 user nova-compute[71364]:   </sysinfo>
Apr 11 22:06:24 user nova-compute[71364]:   <os>
Apr 11 22:06:24 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:06:24 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:06:24 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:06:24 user nova-compute[71364]:   </os>
Apr 11 22:06:24 user nova-compute[71364]:   <features>
Apr 11 22:06:24 user nova-compute[71364]:     <acpi/>
Apr 11 22:06:24 user nova-compute[71364]:     <apic/>
Apr 11 22:06:24 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:06:24 user nova-compute[71364]:   </features>
Apr 11 22:06:24 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:06:24 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:06:24 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:06:24 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:06:24 user nova-compute[71364]:   </clock>
Apr 11 22:06:24 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:06:24 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:06:24 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:06:24 user nova-compute[71364]:   </cpu>
Apr 11 22:06:24 user nova-compute[71364]:   <devices>
Apr 11 22:06:24 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 22:06:24 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:06:24 user nova-compute[71364]:       <source dev="/dev/sde"/>
Apr 11 22:06:24 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:06:24 user nova-compute[71364]:       <serial>68c0a458-6bd5-45d6-b87b-1d992e32f75c</serial>
Apr 11 22:06:24 user nova-compute[71364]:     </disk>
Apr 11 22:06:24 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:06:24 user nova-compute[71364]:       <mac address="fa:16:3e:40:36:11"/>
Apr 11 22:06:24 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:06:24 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:06:24 user nova-compute[71364]:       <target dev="tapb0b481ae-0b"/>
Apr 11 22:06:24 user nova-compute[71364]:     </interface>
Apr 11 22:06:24 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:06:24 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d/console.log" append="off"/>
Apr 11 22:06:24 user nova-compute[71364]:     </serial>
Apr 11 22:06:24 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:06:24 user nova-compute[71364]:     <video>
Apr 11 22:06:24 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:06:24 user nova-compute[71364]:     </video>
Apr 11 22:06:24 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:06:24 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:06:24 user nova-compute[71364]:     </rng>
Apr 11 22:06:24 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:06:24 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:06:24 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:06:24 user nova-compute[71364]:     </memballoon>
Apr 11 22:06:24 user nova-compute[71364]:   </devices>
Apr 11 22:06:24 user nova-compute[71364]: </domain>
Apr 11 22:06:24 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1084422016',display_name='tempest-ServerActionsTestJSON-server-1084422016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1084422016',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-3j4bwdo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:06:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:36:11,bridge_name='br-int',has_traffic_filtering=True,id=b0b481ae-0b9d-4aac-ad21-f165acd47d15,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b481ae-0b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG os_vif [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:36:11,bridge_name='br-int',has_traffic_filtering=True,id=b0b481ae-0b9d-4aac-ad21-f165acd47d15,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b481ae-0b') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0b481ae-0b, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0b481ae-0b, col_values=(('external_ids', {'iface-id': 'b0b481ae-0b9d-4aac-ad21-f165acd47d15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:36:11', 'vm-uuid': 'ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:24 user nova-compute[71364]: INFO os_vif [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:36:11,bridge_name='br-int',has_traffic_filtering=True,id=b0b481ae-0b9d-4aac-ad21-f165acd47d15,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b481ae-0b')
Apr 11 22:06:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:06:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No VIF found with MAC fa:16:3e:40:36:11, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:06:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:26 user nova-compute[71364]: DEBUG nova.compute.manager [req-45c0d30b-3d09-4455-b534-a7e60b5ea8a4 req-8bdc6a5b-aa29-4d22-871f-d3d75b71cbe4 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received event network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-45c0d30b-3d09-4455-b534-a7e60b5ea8a4 req-8bdc6a5b-aa29-4d22-871f-d3d75b71cbe4 service nova] Acquiring lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-45c0d30b-3d09-4455-b534-a7e60b5ea8a4 req-8bdc6a5b-aa29-4d22-871f-d3d75b71cbe4 service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-45c0d30b-3d09-4455-b534-a7e60b5ea8a4 req-8bdc6a5b-aa29-4d22-871f-d3d75b71cbe4 service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:26 user nova-compute[71364]: DEBUG nova.compute.manager [req-45c0d30b-3d09-4455-b534-a7e60b5ea8a4 req-8bdc6a5b-aa29-4d22-871f-d3d75b71cbe4 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] No waiting events found dispatching network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:26 user nova-compute[71364]: WARNING nova.compute.manager [req-45c0d30b-3d09-4455-b534-a7e60b5ea8a4 req-8bdc6a5b-aa29-4d22-871f-d3d75b71cbe4 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received unexpected event network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance with vm_state building and task_state spawning.
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250787.9178703, ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:06:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] VM Resumed (Lifecycle Event)
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:06:27 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Instance spawned successfully.
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250787.9194877, ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:06:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] VM Started (Lifecycle Event)
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:06:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:06:28 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:06:28 user nova-compute[71364]: INFO nova.compute.manager [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Took 4.98 seconds to spawn the instance on the hypervisor.
Apr 11 22:06:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:06:28 user nova-compute[71364]: DEBUG nova.compute.manager [req-831e6299-8996-430e-a569-5e64ee8a2d92 req-620c0f17-40ba-4bf6-a90d-4e5953717537 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received event network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-831e6299-8996-430e-a569-5e64ee8a2d92 req-620c0f17-40ba-4bf6-a90d-4e5953717537 service nova] Acquiring lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-831e6299-8996-430e-a569-5e64ee8a2d92 req-620c0f17-40ba-4bf6-a90d-4e5953717537 service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-831e6299-8996-430e-a569-5e64ee8a2d92 req-620c0f17-40ba-4bf6-a90d-4e5953717537 service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:28 user nova-compute[71364]: DEBUG nova.compute.manager [req-831e6299-8996-430e-a569-5e64ee8a2d92 req-620c0f17-40ba-4bf6-a90d-4e5953717537 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] No waiting events found dispatching network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:28 user nova-compute[71364]: WARNING nova.compute.manager [req-831e6299-8996-430e-a569-5e64ee8a2d92 req-620c0f17-40ba-4bf6-a90d-4e5953717537 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received unexpected event network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance with vm_state building and task_state spawning.
Apr 11 22:06:28 user nova-compute[71364]: INFO nova.compute.manager [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Took 10.25 seconds to build instance.
Apr 11 22:06:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.344s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 29e6c78a-dee0-4d28-86cd-debad15718d4 {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid b66951a9-73f3-41ce-9f19-b4e5e24d61b0 {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid c48d8944-6010-4d8d-9761-6ee0d7cd005b {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid d6268190-2187-4596-9f0b-026c520e5c67 {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 9e44ad56-d695-409c-9d35-3d3dec2c3a89 {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 3b74e50d-0c81-4c84-a97a-2e22a0524a93 {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "29e6c78a-dee0-4d28-86cd-debad15718d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "d6268190-2187-4596-9f0b-026c520e5c67" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "d6268190-2187-4596-9f0b-026c520e5c67" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.003s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "d6268190-2187-4596-9f0b-026c520e5c67" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:06:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:06:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:06:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:06:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:06:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-e41f8b15-898d-43b6-8e64-eb47918dc0b7 req-073a17b7-51e8-467f-bf03-affb6c3817d2 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Received event network-changed-660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-e41f8b15-898d-43b6-8e64-eb47918dc0b7 req-073a17b7-51e8-467f-bf03-affb6c3817d2 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Refreshing instance network info cache due to event network-changed-660ded54-a2aa-4862-91a0-1aa1948cb5a0. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:06:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e41f8b15-898d-43b6-8e64-eb47918dc0b7 req-073a17b7-51e8-467f-bf03-affb6c3817d2 service nova] Acquiring lock "refresh_cache-5366a438-0f96-4ae2-8c99-48f98501baa3" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:06:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e41f8b15-898d-43b6-8e64-eb47918dc0b7 req-073a17b7-51e8-467f-bf03-affb6c3817d2 service nova] Acquired lock "refresh_cache-5366a438-0f96-4ae2-8c99-48f98501baa3" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:06:42 user nova-compute[71364]: DEBUG nova.network.neutron [req-e41f8b15-898d-43b6-8e64-eb47918dc0b7 req-073a17b7-51e8-467f-bf03-affb6c3817d2 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Refreshing network info cache for port 660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:06:42 user nova-compute[71364]: DEBUG nova.network.neutron [req-e41f8b15-898d-43b6-8e64-eb47918dc0b7 req-073a17b7-51e8-467f-bf03-affb6c3817d2 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Updated VIF entry in instance network info cache for port 660ded54-a2aa-4862-91a0-1aa1948cb5a0. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:06:42 user nova-compute[71364]: DEBUG nova.network.neutron [req-e41f8b15-898d-43b6-8e64-eb47918dc0b7 req-073a17b7-51e8-467f-bf03-affb6c3817d2 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Updating instance_info_cache with network_info: [{"id": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "address": "fa:16:3e:49:5f:74", "network": {"id": "b465435f-c5f6-4407-a24c-2a48de8b4b28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28080865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99e47eb6cfb467a943499e4b6172d5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660ded54-a2", "ovs_interfaceid": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:06:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e41f8b15-898d-43b6-8e64-eb47918dc0b7 req-073a17b7-51e8-467f-bf03-affb6c3817d2 service nova] Releasing lock "refresh_cache-5366a438-0f96-4ae2-8c99-48f98501baa3" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:44 user nova-compute[71364]: INFO nova.compute.manager [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Terminating instance
Apr 11 22:06:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:44 user nova-compute[71364]: INFO nova.compute.manager [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Terminating instance
Apr 11 22:06:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.compute.manager [req-a3c88c15-15ec-4569-9f56-4718306a99ca req-2b98bc75-0694-4efd-a19a-73b1fd2aeb88 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Received event network-vif-unplugged-660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a3c88c15-15ec-4569-9f56-4718306a99ca req-2b98bc75-0694-4efd-a19a-73b1fd2aeb88 service nova] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a3c88c15-15ec-4569-9f56-4718306a99ca req-2b98bc75-0694-4efd-a19a-73b1fd2aeb88 service nova] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a3c88c15-15ec-4569-9f56-4718306a99ca req-2b98bc75-0694-4efd-a19a-73b1fd2aeb88 service nova] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.compute.manager [req-a3c88c15-15ec-4569-9f56-4718306a99ca req-2b98bc75-0694-4efd-a19a-73b1fd2aeb88 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] No waiting events found dispatching network-vif-unplugged-660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.compute.manager [req-a3c88c15-15ec-4569-9f56-4718306a99ca req-2b98bc75-0694-4efd-a19a-73b1fd2aeb88 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Received event network-vif-unplugged-660ded54-a2aa-4862-91a0-1aa1948cb5a0 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.compute.manager [req-50cc41a7-003f-4f4d-b81f-8268833fe9a0 req-dd632aef-7e39-4583-9200-e250936f4ad6 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-50cc41a7-003f-4f4d-b81f-8268833fe9a0 req-dd632aef-7e39-4583-9200-e250936f4ad6 service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-50cc41a7-003f-4f4d-b81f-8268833fe9a0 req-dd632aef-7e39-4583-9200-e250936f4ad6 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-50cc41a7-003f-4f4d-b81f-8268833fe9a0 req-dd632aef-7e39-4583-9200-e250936f4ad6 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.compute.manager [req-50cc41a7-003f-4f4d-b81f-8268833fe9a0 req-dd632aef-7e39-4583-9200-e250936f4ad6 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.compute.manager [req-50cc41a7-003f-4f4d-b81f-8268833fe9a0 req-dd632aef-7e39-4583-9200-e250936f4ad6 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:45 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Instance destroyed successfully.
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'resources' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:00:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1212824966',display_name='tempest-SnapshotDataIntegrityTests-server-1212824966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1212824966',id=26,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBzUl8HvDUTg7Id3OSxTvkzP49WOAu3H283oGSTgo0KG3nA0bN4Q4nshmcPLueExTWYD/2zosDdYSCOikl8MUtstEkFgvYKkQYR8M0ySMROhbHmo+3F6wBPo0mNlx825g==',key_name='tempest-SnapshotDataIntegrityTests-1090433161',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:00:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b99e47eb6cfb467a943499e4b6172d5d',ramdisk_id='',reservation_id='r-qq7u7682',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-328709204',owner_user_name='tempest-SnapshotDataIntegrityTests-328709204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:00:42Z,user_data=None,user_id='c8bf56678e2a43108a7732fb0b2ea44c',uuid=5366a438-0f96-4ae2-8c99-48f98501baa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "address": "fa:16:3e:49:5f:74", "network": {"id": "b465435f-c5f6-4407-a24c-2a48de8b4b28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28080865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99e47eb6cfb467a943499e4b6172d5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660ded54-a2", "ovs_interfaceid": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Converting VIF {"id": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "address": "fa:16:3e:49:5f:74", "network": {"id": "b465435f-c5f6-4407-a24c-2a48de8b4b28", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-28080865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b99e47eb6cfb467a943499e4b6172d5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap660ded54-a2", "ovs_interfaceid": "660ded54-a2aa-4862-91a0-1aa1948cb5a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:5f:74,bridge_name='br-int',has_traffic_filtering=True,id=660ded54-a2aa-4862-91a0-1aa1948cb5a0,network=Network(b465435f-c5f6-4407-a24c-2a48de8b4b28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660ded54-a2') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG os_vif [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:5f:74,bridge_name='br-int',has_traffic_filtering=True,id=660ded54-a2aa-4862-91a0-1aa1948cb5a0,network=Network(b465435f-c5f6-4407-a24c-2a48de8b4b28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660ded54-a2') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap660ded54-a2, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:45 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Instance destroyed successfully.
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.objects.instance [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'resources' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:45 user nova-compute[71364]: INFO os_vif [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:5f:74,bridge_name='br-int',has_traffic_filtering=True,id=660ded54-a2aa-4862-91a0-1aa1948cb5a0,network=Network(b465435f-c5f6-4407-a24c-2a48de8b4b28),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap660ded54-a2')
Apr 11 22:06:45 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Deleting instance files /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3_del
Apr 11 22:06:45 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Deletion of /opt/stack/data/nova/instances/5366a438-0f96-4ae2-8c99-48f98501baa3_del complete
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-725789604',display_name='tempest-AttachVolumeTestJSON-server-725789604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-725789604',id=23,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYwKlNnt0rCNL8sjxDa6Udl9GHywucHycueHP/WPlPumIvAabJq5jTPAthhGusMxnokX9UxhPJGgZI9+13actfeG6CHskRBehNb6fTqc1ot1bspfEW3rpY449P/8ec+gw==',key_name='tempest-keypair-654553624',keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:57:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5aa35cf81ae74532a074bde65f192848',ramdisk_id='',reservation_id='r-q3i4b0c1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1865595781',owner_user_name='tempest-AttachVolumeTestJSON-1865595781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:04:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76211a47ed9b4a8abdeeea98c774d3d7',uuid=53530e4f-a899-496d-8b83-a3b5f7dbc7ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converting VIF {"id": "914c7aea-325c-4061-893a-353590f63b84", "address": "fa:16:3e:fb:64:5e", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap914c7aea-32", "ovs_interfaceid": "914c7aea-325c-4061-893a-353590f63b84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG os_vif [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap914c7aea-32, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:06:45 user nova-compute[71364]: INFO os_vif [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:64:5e,bridge_name='br-int',has_traffic_filtering=True,id=914c7aea-325c-4061-893a-353590f63b84,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap914c7aea-32')
Apr 11 22:06:45 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Deleting instance files /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea_del
Apr 11 22:06:45 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Deletion of /opt/stack/data/nova/instances/53530e4f-a899-496d-8b83-a3b5f7dbc7ea_del complete
Apr 11 22:06:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:45 user nova-compute[71364]: INFO nova.compute.manager [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 11 22:06:45 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:06:45 user nova-compute[71364]: INFO nova.compute.manager [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Took 1.27 seconds to destroy the instance on the hypervisor.
Apr 11 22:06:45 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:06:45 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:06:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:46 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:06:46 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Took 0.72 seconds to deallocate network for instance.
Apr 11 22:06:46 user nova-compute[71364]: DEBUG nova.compute.manager [req-f1974157-232c-4c58-8748-c4cee5f32611 req-04dc5803-541f-4ccf-8da3-5a99fe0e9c3e service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Received event network-vif-deleted-660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-9dcaba85-970f-4f44-b891-0906709e18ed req-370c361f-899a-4f8a-bd7b-e5ff14222590 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Received event network-vif-plugged-660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9dcaba85-970f-4f44-b891-0906709e18ed req-370c361f-899a-4f8a-bd7b-e5ff14222590 service nova] Acquiring lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9dcaba85-970f-4f44-b891-0906709e18ed req-370c361f-899a-4f8a-bd7b-e5ff14222590 service nova] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9dcaba85-970f-4f44-b891-0906709e18ed req-370c361f-899a-4f8a-bd7b-e5ff14222590 service nova] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-9dcaba85-970f-4f44-b891-0906709e18ed req-370c361f-899a-4f8a-bd7b-e5ff14222590 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] No waiting events found dispatching network-vif-plugged-660ded54-a2aa-4862-91a0-1aa1948cb5a0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:47 user nova-compute[71364]: WARNING nova.compute.manager [req-9dcaba85-970f-4f44-b891-0906709e18ed req-370c361f-899a-4f8a-bd7b-e5ff14222590 service nova] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Received unexpected event network-vif-plugged-660ded54-a2aa-4862-91a0-1aa1948cb5a0 for instance with vm_state deleted and task_state None.
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:47 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Deleted allocations for instance 5366a438-0f96-4ae2-8c99-48f98501baa3
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:47 user nova-compute[71364]: WARNING nova.compute.manager [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state active and task_state deleting.
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:47 user nova-compute[71364]: WARNING nova.compute.manager [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state active and task_state deleting.
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:47 user nova-compute[71364]: WARNING nova.compute.manager [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state active and task_state deleting.
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-unplugged-914c7aea-325c-4061-893a-353590f63b84 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:06:47 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Took 1.31 seconds to deallocate network for instance.
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "5366a438-0f96-4ae2-8c99-48f98501baa3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.593s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:47 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Deleted allocations for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea
Apr 11 22:06:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.069s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-df69813b-352e-4234-a19c-814bb2a5cb2f req-13e10469-7139-4833-af81-7e8990c4223f service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-df69813b-352e-4234-a19c-814bb2a5cb2f req-13e10469-7139-4833-af81-7e8990c4223f service nova] Acquiring lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-df69813b-352e-4234-a19c-814bb2a5cb2f req-13e10469-7139-4833-af81-7e8990c4223f service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-df69813b-352e-4234-a19c-814bb2a5cb2f req-13e10469-7139-4833-af81-7e8990c4223f service nova] Lock "53530e4f-a899-496d-8b83-a3b5f7dbc7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-df69813b-352e-4234-a19c-814bb2a5cb2f req-13e10469-7139-4833-af81-7e8990c4223f service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] No waiting events found dispatching network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:49 user nova-compute[71364]: WARNING nova.compute.manager [req-df69813b-352e-4234-a19c-814bb2a5cb2f req-13e10469-7139-4833-af81-7e8990c4223f service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received unexpected event network-vif-plugged-914c7aea-325c-4061-893a-353590f63b84 for instance with vm_state deleted and task_state None.
Apr 11 22:06:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-df69813b-352e-4234-a19c-814bb2a5cb2f req-13e10469-7139-4833-af81-7e8990c4223f service nova] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Received event network-vif-deleted-914c7aea-325c-4061-893a-353590f63b84 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "c564e327-b508-4b88-a393-e30a166ac848" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "c564e327-b508-4b88-a393-e30a166ac848" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:50 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:06:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:50 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:06:50 user nova-compute[71364]: INFO nova.compute.claims [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Claim successful on node user
Apr 11 22:06:51 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG nova.network.neutron [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:06:51 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:06:51 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG nova.policy [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:06:51 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Creating image(s)
Apr 11 22:06:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "/opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "/opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "/opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk 1073741824" returned: 0 in 0.047s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:52 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:06:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:06:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:06:52 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Cannot resize image /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:06:52 user nova-compute[71364]: DEBUG nova.objects.instance [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'migration_context' on Instance uuid c564e327-b508-4b88-a393-e30a166ac848 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:06:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:06:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Ensure instance console log exists: /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:06:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:52 user nova-compute[71364]: DEBUG nova.network.neutron [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Successfully created port: 379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.network.neutron [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Successfully updated port: 379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "refresh_cache-c564e327-b508-4b88-a393-e30a166ac848" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquired lock "refresh_cache-c564e327-b508-4b88-a393-e30a166ac848" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.network.neutron [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-1cb6bcca-b1d1-4b92-9e46-6d1a5cd8b55b req-9fc81fc0-c348-4256-81e9-1a9e2986152c service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Received event network-changed-379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-1cb6bcca-b1d1-4b92-9e46-6d1a5cd8b55b req-9fc81fc0-c348-4256-81e9-1a9e2986152c service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Refreshing instance network info cache due to event network-changed-379495b1-9aee-4d67-8b10-517792434e1b. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1cb6bcca-b1d1-4b92-9e46-6d1a5cd8b55b req-9fc81fc0-c348-4256-81e9-1a9e2986152c service nova] Acquiring lock "refresh_cache-c564e327-b508-4b88-a393-e30a166ac848" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.network.neutron [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.network.neutron [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Updating instance_info_cache with network_info: [{"id": "379495b1-9aee-4d67-8b10-517792434e1b", "address": "fa:16:3e:aa:2c:cf", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap379495b1-9a", "ovs_interfaceid": "379495b1-9aee-4d67-8b10-517792434e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Releasing lock "refresh_cache-c564e327-b508-4b88-a393-e30a166ac848" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Instance network_info: |[{"id": "379495b1-9aee-4d67-8b10-517792434e1b", "address": "fa:16:3e:aa:2c:cf", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap379495b1-9a", "ovs_interfaceid": "379495b1-9aee-4d67-8b10-517792434e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1cb6bcca-b1d1-4b92-9e46-6d1a5cd8b55b req-9fc81fc0-c348-4256-81e9-1a9e2986152c service nova] Acquired lock "refresh_cache-c564e327-b508-4b88-a393-e30a166ac848" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.network.neutron [req-1cb6bcca-b1d1-4b92-9e46-6d1a5cd8b55b req-9fc81fc0-c348-4256-81e9-1a9e2986152c service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Refreshing network info cache for port 379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Start _get_guest_xml network_info=[{"id": "379495b1-9aee-4d67-8b10-517792434e1b", "address": "fa:16:3e:aa:2c:cf", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap379495b1-9a", "ovs_interfaceid": "379495b1-9aee-4d67-8b10-517792434e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:06:53 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:06:53 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-303719685',display_name='tempest-AttachVolumeNegativeTest-server-303719685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-303719685',id=34,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYj0hQ2mfvO6PnRQDsRwvFRKSTCH4FHgJv4ERFWLkIIYi1p1NYH+rIsvWwsFXfCZJbajB3xQDgUUVssjT2WCxobuMqhpq9I2t6v+G1412BqLx+cDG4G0enxUnO2r0pY/g==',key_name='tempest-keypair-268153557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='722a2704f607415ebe42af5ad98bf419',ramdisk_id='',reservation_id='r-jyc18oia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2131251711',owner_user_name='tempest-AttachVolumeNegativeTest-2131251711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d615e85afb4354b37e88b5a24429d8',uuid=c564e327-b508-4b88-a393-e30a166ac848,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "379495b1-9aee-4d67-8b10-517792434e1b", "address": "fa:16:3e:aa:2c:cf", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap379495b1-9a", "ovs_interfaceid": "379495b1-9aee-4d67-8b10-517792434e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converting VIF {"id": "379495b1-9aee-4d67-8b10-517792434e1b", "address": "fa:16:3e:aa:2c:cf", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap379495b1-9a", "ovs_interfaceid": "379495b1-9aee-4d67-8b10-517792434e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:2c:cf,bridge_name='br-int',has_traffic_filtering=True,id=379495b1-9aee-4d67-8b10-517792434e1b,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap379495b1-9a') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.objects.instance [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'pci_devices' on Instance uuid c564e327-b508-4b88-a393-e30a166ac848 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:06:53 user nova-compute[71364]:   <uuid>c564e327-b508-4b88-a393-e30a166ac848</uuid>
Apr 11 22:06:53 user nova-compute[71364]:   <name>instance-00000022</name>
Apr 11 22:06:53 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:06:53 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:06:53 user nova-compute[71364]:   <metadata>
Apr 11 22:06:53 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:06:53 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:06:53 user nova-compute[71364]:       <nova:name>tempest-AttachVolumeNegativeTest-server-303719685</nova:name>
Apr 11 22:06:53 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:06:53</nova:creationTime>
Apr 11 22:06:53 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:06:53 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:06:53 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:06:53 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:06:53 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:06:53 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:06:53 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:06:53 user nova-compute[71364]:       <nova:owner>
Apr 11 22:06:53 user nova-compute[71364]:         <nova:user uuid="b6d615e85afb4354b37e88b5a24429d8">tempest-AttachVolumeNegativeTest-2131251711-project-member</nova:user>
Apr 11 22:06:53 user nova-compute[71364]:         <nova:project uuid="722a2704f607415ebe42af5ad98bf419">tempest-AttachVolumeNegativeTest-2131251711</nova:project>
Apr 11 22:06:53 user nova-compute[71364]:       </nova:owner>
Apr 11 22:06:53 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:06:53 user nova-compute[71364]:       <nova:ports>
Apr 11 22:06:53 user nova-compute[71364]:         <nova:port uuid="379495b1-9aee-4d67-8b10-517792434e1b">
Apr 11 22:06:53 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 22:06:53 user nova-compute[71364]:         </nova:port>
Apr 11 22:06:53 user nova-compute[71364]:       </nova:ports>
Apr 11 22:06:53 user nova-compute[71364]:     </nova:instance>
Apr 11 22:06:53 user nova-compute[71364]:   </metadata>
Apr 11 22:06:53 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:06:53 user nova-compute[71364]:     <system>
Apr 11 22:06:53 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:06:53 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:06:53 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:06:53 user nova-compute[71364]:       <entry name="serial">c564e327-b508-4b88-a393-e30a166ac848</entry>
Apr 11 22:06:53 user nova-compute[71364]:       <entry name="uuid">c564e327-b508-4b88-a393-e30a166ac848</entry>
Apr 11 22:06:53 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:06:53 user nova-compute[71364]:     </system>
Apr 11 22:06:53 user nova-compute[71364]:   </sysinfo>
Apr 11 22:06:53 user nova-compute[71364]:   <os>
Apr 11 22:06:53 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:06:53 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:06:53 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:06:53 user nova-compute[71364]:   </os>
Apr 11 22:06:53 user nova-compute[71364]:   <features>
Apr 11 22:06:53 user nova-compute[71364]:     <acpi/>
Apr 11 22:06:53 user nova-compute[71364]:     <apic/>
Apr 11 22:06:53 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:06:53 user nova-compute[71364]:   </features>
Apr 11 22:06:53 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:06:53 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:06:53 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:06:53 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:06:53 user nova-compute[71364]:   </clock>
Apr 11 22:06:53 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:06:53 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:06:53 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:06:53 user nova-compute[71364]:   </cpu>
Apr 11 22:06:53 user nova-compute[71364]:   <devices>
Apr 11 22:06:53 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:06:53 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:06:53 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk"/>
Apr 11 22:06:53 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:06:53 user nova-compute[71364]:     </disk>
Apr 11 22:06:53 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:06:53 user nova-compute[71364]:       <mac address="fa:16:3e:aa:2c:cf"/>
Apr 11 22:06:53 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:06:53 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:06:53 user nova-compute[71364]:       <target dev="tap379495b1-9a"/>
Apr 11 22:06:53 user nova-compute[71364]:     </interface>
Apr 11 22:06:53 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:06:53 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/console.log" append="off"/>
Apr 11 22:06:53 user nova-compute[71364]:     </serial>
Apr 11 22:06:53 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:06:53 user nova-compute[71364]:     <video>
Apr 11 22:06:53 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:06:53 user nova-compute[71364]:     </video>
Apr 11 22:06:53 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:06:53 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:06:53 user nova-compute[71364]:     </rng>
Apr 11 22:06:53 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:06:53 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:06:53 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:06:53 user nova-compute[71364]:     </memballoon>
Apr 11 22:06:53 user nova-compute[71364]:   </devices>
Apr 11 22:06:53 user nova-compute[71364]: </domain>
Apr 11 22:06:53 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-303719685',display_name='tempest-AttachVolumeNegativeTest-server-303719685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-303719685',id=34,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYj0hQ2mfvO6PnRQDsRwvFRKSTCH4FHgJv4ERFWLkIIYi1p1NYH+rIsvWwsFXfCZJbajB3xQDgUUVssjT2WCxobuMqhpq9I2t6v+G1412BqLx+cDG4G0enxUnO2r0pY/g==',key_name='tempest-keypair-268153557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='722a2704f607415ebe42af5ad98bf419',ramdisk_id='',reservation_id='r-jyc18oia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2131251711',owner_user_name='tempest-AttachVolumeNegativeTest-2131251711-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:06:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d615e85afb4354b37e88b5a24429d8',uuid=c564e327-b508-4b88-a393-e30a166ac848,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "379495b1-9aee-4d67-8b10-517792434e1b", "address": "fa:16:3e:aa:2c:cf", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap379495b1-9a", "ovs_interfaceid": "379495b1-9aee-4d67-8b10-517792434e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converting VIF {"id": "379495b1-9aee-4d67-8b10-517792434e1b", "address": "fa:16:3e:aa:2c:cf", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap379495b1-9a", "ovs_interfaceid": "379495b1-9aee-4d67-8b10-517792434e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:2c:cf,bridge_name='br-int',has_traffic_filtering=True,id=379495b1-9aee-4d67-8b10-517792434e1b,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap379495b1-9a') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG os_vif [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:2c:cf,bridge_name='br-int',has_traffic_filtering=True,id=379495b1-9aee-4d67-8b10-517792434e1b,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap379495b1-9a') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap379495b1-9a, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap379495b1-9a, col_values=(('external_ids', {'iface-id': '379495b1-9aee-4d67-8b10-517792434e1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:2c:cf', 'vm-uuid': 'c564e327-b508-4b88-a393-e30a166ac848'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:53 user nova-compute[71364]: INFO os_vif [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:2c:cf,bridge_name='br-int',has_traffic_filtering=True,id=379495b1-9aee-4d67-8b10-517792434e1b,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap379495b1-9a')
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:06:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No VIF found with MAC fa:16:3e:aa:2c:cf, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:06:54 user nova-compute[71364]: DEBUG nova.network.neutron [req-1cb6bcca-b1d1-4b92-9e46-6d1a5cd8b55b req-9fc81fc0-c348-4256-81e9-1a9e2986152c service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Updated VIF entry in instance network info cache for port 379495b1-9aee-4d67-8b10-517792434e1b. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:06:54 user nova-compute[71364]: DEBUG nova.network.neutron [req-1cb6bcca-b1d1-4b92-9e46-6d1a5cd8b55b req-9fc81fc0-c348-4256-81e9-1a9e2986152c service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Updating instance_info_cache with network_info: [{"id": "379495b1-9aee-4d67-8b10-517792434e1b", "address": "fa:16:3e:aa:2c:cf", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap379495b1-9a", "ovs_interfaceid": "379495b1-9aee-4d67-8b10-517792434e1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:06:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1cb6bcca-b1d1-4b92-9e46-6d1a5cd8b55b req-9fc81fc0-c348-4256-81e9-1a9e2986152c service nova] Releasing lock "refresh_cache-c564e327-b508-4b88-a393-e30a166ac848" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:06:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:55 user nova-compute[71364]: DEBUG nova.compute.manager [req-12efbd78-b559-489f-9a6f-98f458181a61 req-5c6b9139-6805-4a39-9f3e-1d8b5b66da5b service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Received event network-vif-plugged-379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-12efbd78-b559-489f-9a6f-98f458181a61 req-5c6b9139-6805-4a39-9f3e-1d8b5b66da5b service nova] Acquiring lock "c564e327-b508-4b88-a393-e30a166ac848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-12efbd78-b559-489f-9a6f-98f458181a61 req-5c6b9139-6805-4a39-9f3e-1d8b5b66da5b service nova] Lock "c564e327-b508-4b88-a393-e30a166ac848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-12efbd78-b559-489f-9a6f-98f458181a61 req-5c6b9139-6805-4a39-9f3e-1d8b5b66da5b service nova] Lock "c564e327-b508-4b88-a393-e30a166ac848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:55 user nova-compute[71364]: DEBUG nova.compute.manager [req-12efbd78-b559-489f-9a6f-98f458181a61 req-5c6b9139-6805-4a39-9f3e-1d8b5b66da5b service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] No waiting events found dispatching network-vif-plugged-379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:55 user nova-compute[71364]: WARNING nova.compute.manager [req-12efbd78-b559-489f-9a6f-98f458181a61 req-5c6b9139-6805-4a39-9f3e-1d8b5b66da5b service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Received unexpected event network-vif-plugged-379495b1-9aee-4d67-8b10-517792434e1b for instance with vm_state building and task_state spawning.
Apr 11 22:06:55 user nova-compute[71364]: INFO nova.compute.manager [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Unrescuing
Apr 11 22:06:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:06:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquired lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:06:55 user nova-compute[71364]: DEBUG nova.network.neutron [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:06:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:56 user nova-compute[71364]: DEBUG nova.network.neutron [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Updating instance_info_cache with network_info: [{"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:06:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Releasing lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:06:56 user nova-compute[71364]: DEBUG nova.objects.instance [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'flavor' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:06:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:56 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Instance destroyed successfully.
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Received event network-vif-plugged-379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Acquiring lock "c564e327-b508-4b88-a393-e30a166ac848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Lock "c564e327-b508-4b88-a393-e30a166ac848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Lock "c564e327-b508-4b88-a393-e30a166ac848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] No waiting events found dispatching network-vif-plugged-379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:57 user nova-compute[71364]: WARNING nova.compute.manager [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Received unexpected event network-vif-plugged-379495b1-9aee-4d67-8b10-517792434e1b for instance with vm_state building and task_state spawning.
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-vif-unplugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] No waiting events found dispatching network-vif-unplugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:57 user nova-compute[71364]: WARNING nova.compute.manager [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received unexpected event network-vif-unplugged-3b90af5a-ae8d-4876-bda9-002751948bb0 for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] No waiting events found dispatching network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:57 user nova-compute[71364]: WARNING nova.compute.manager [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received unexpected event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250817.3251355, c564e327-b508-4b88-a393-e30a166ac848 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:06:57 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c564e327-b508-4b88-a393-e30a166ac848] VM Resumed (Lifecycle Event)
Apr 11 22:06:57 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: c564e327-b508-4b88-a393-e30a166ac848] Instance spawned successfully.
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c564e327-b508-4b88-a393-e30a166ac848] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c564e327-b508-4b88-a393-e30a166ac848] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:06:57 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c564e327-b508-4b88-a393-e30a166ac848] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250817.328203, c564e327-b508-4b88-a393-e30a166ac848 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:06:57 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c564e327-b508-4b88-a393-e30a166ac848] VM Started (Lifecycle Event)
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c564e327-b508-4b88-a393-e30a166ac848] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c564e327-b508-4b88-a393-e30a166ac848] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:06:57 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c564e327-b508-4b88-a393-e30a166ac848] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:06:57 user nova-compute[71364]: INFO nova.compute.manager [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Took 5.91 seconds to spawn the instance on the hypervisor.
Apr 11 22:06:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:06:57 user nova-compute[71364]: INFO nova.compute.manager [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Took 6.67 seconds to build instance.
Apr 11 22:06:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "c564e327-b508-4b88-a393-e30a166ac848" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.776s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:59 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:06:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:06:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] No waiting events found dispatching network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:59 user nova-compute[71364]: WARNING nova.compute.manager [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received unexpected event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:06:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:06:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:06:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:06:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:06:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] No waiting events found dispatching network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:06:59 user nova-compute[71364]: WARNING nova.compute.manager [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received unexpected event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:07:00 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for b485c9c2-8fb4-4690-af26-ddfae00d5024 due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250820.6324742, b485c9c2-8fb4-4690-af26-ddfae00d5024 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:07:00 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] VM Resumed (Lifecycle Event)
Apr 11 22:07:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:07:00 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 22:07:00 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250820.6341631, b485c9c2-8fb4-4690-af26-ddfae00d5024 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:07:00 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] VM Started (Lifecycle Event)
Apr 11 22:07:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250805.7606027, 5366a438-0f96-4ae2-8c99-48f98501baa3 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:07:00 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] VM Stopped (Lifecycle Event)
Apr 11 22:07:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-f6366d55-da93-4fc7-be49-e0c2d81994d3 None None] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250805.817052, 53530e4f-a899-496d-8b83-a3b5f7dbc7ea => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:07:00 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] VM Stopped (Lifecycle Event)
Apr 11 22:07:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a206a7b3-edf7-4ee7-990b-6ff6450bcdac None None] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:03 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:07:03 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:07:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7925MB free_disk=26.117168426513672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d6268190-2187-4596-9f0b-026c520e5c67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b485c9c2-8fb4-4690-af26-ddfae00d5024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c564e327-b508-4b88-a393-e30a166ac848 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:07:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:07:04 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:07:04 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:07:04 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:07:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Updating instance_info_cache with network_info: [{"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:07:07 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:07:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:07:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:33 user nova-compute[71364]: INFO nova.compute.manager [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Rescuing
Apr 11 22:07:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "refresh_cache-3b74e50d-0c81-4c84-a97a-2e22a0524a93" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:07:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquired lock "refresh_cache-3b74e50d-0c81-4c84-a97a-2e22a0524a93" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:07:33 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:07:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:33 user nova-compute[71364]: DEBUG nova.network.neutron [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Updating instance_info_cache with network_info: [{"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:07:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Releasing lock "refresh_cache-3b74e50d-0c81-4c84-a97a-2e22a0524a93" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:07:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:34 user nova-compute[71364]: DEBUG nova.compute.manager [req-5c7f449c-1d08-40ae-809d-9913b326f98d req-e7c511f4-ecdd-4403-a3ed-c570b76675a7 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-vif-unplugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:07:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5c7f449c-1d08-40ae-809d-9913b326f98d req-e7c511f4-ecdd-4403-a3ed-c570b76675a7 service nova] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5c7f449c-1d08-40ae-809d-9913b326f98d req-e7c511f4-ecdd-4403-a3ed-c570b76675a7 service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5c7f449c-1d08-40ae-809d-9913b326f98d req-e7c511f4-ecdd-4403-a3ed-c570b76675a7 service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:34 user nova-compute[71364]: DEBUG nova.compute.manager [req-5c7f449c-1d08-40ae-809d-9913b326f98d req-e7c511f4-ecdd-4403-a3ed-c570b76675a7 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] No waiting events found dispatching network-vif-unplugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:07:34 user nova-compute[71364]: WARNING nova.compute.manager [req-5c7f449c-1d08-40ae-809d-9913b326f98d req-e7c511f4-ecdd-4403-a3ed-c570b76675a7 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received unexpected event network-vif-unplugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance with vm_state active and task_state rescuing.
Apr 11 22:07:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:34 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Instance destroyed successfully.
Apr 11 22:07:34 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Attempting a stable device rescue
Apr 11 22:07:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71364) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 11 22:07:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Instance directory exists: not creating {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 22:07:34 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Creating image(s)
Apr 11 22:07:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "/opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "/opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:34 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3b74e50d-0c81-4c84-a97a-2e22a0524a93 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:07:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "15b56df91235533f7960d332bd2405eef1867f98" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "15b56df91235533f7960d332bd2405eef1867f98" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98.part --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98.part --force-share --output=json" returned: 0 in 0.151s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:35 user nova-compute[71364]: DEBUG nova.virt.images [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 165e874b-2257-4055-b53a-c54070838b05 was qcow2, converting to raw {{(pid=71364) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 22:07:35 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 22:07:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98.part /opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98.converted {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.compute.manager [req-335bc3c2-4a0b-42f1-985a-b98657b12cb8 req-611e0047-a6dc-4189-9d62-6e7aa17bc46e service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-335bc3c2-4a0b-42f1-985a-b98657b12cb8 req-611e0047-a6dc-4189-9d62-6e7aa17bc46e service nova] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-335bc3c2-4a0b-42f1-985a-b98657b12cb8 req-611e0047-a6dc-4189-9d62-6e7aa17bc46e service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-335bc3c2-4a0b-42f1-985a-b98657b12cb8 req-611e0047-a6dc-4189-9d62-6e7aa17bc46e service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.compute.manager [req-335bc3c2-4a0b-42f1-985a-b98657b12cb8 req-611e0047-a6dc-4189-9d62-6e7aa17bc46e service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] No waiting events found dispatching network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:07:36 user nova-compute[71364]: WARNING nova.compute.manager [req-335bc3c2-4a0b-42f1-985a-b98657b12cb8 req-611e0047-a6dc-4189-9d62-6e7aa17bc46e service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received unexpected event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance with vm_state active and task_state rescuing.
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98.part /opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98.converted" returned: 0 in 0.626s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98.converted --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "15b56df91235533f7960d332bd2405eef1867f98" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.832s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "15b56df91235533f7960d332bd2405eef1867f98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "15b56df91235533f7960d332bd2405eef1867f98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98 --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98,backing_fmt=raw /opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/disk.rescue {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98,backing_fmt=raw /opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/disk.rescue" returned: 0 in 0.049s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "15b56df91235533f7960d332bd2405eef1867f98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'migration_context' on Instance uuid 3b74e50d-0c81-4c84-a97a-2e22a0524a93 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Start _get_guest_xml network_info=[{"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "vif_mac": "fa:16:3e:60:74:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '165e874b-2257-4055-b53a-c54070838b05', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCxnpyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '3b74e50d-0c81-4c84-a97a-2e22a0524a93', 'attached_at': '', 'detached_at': '', 'volume_id': '1a70f8fe-561d-4836-b2b4-775fe6e2b4ba', 'serial': '1a70f8fe-561d-4836-b2b4-775fe6e2b4ba'}, 'attachment_id': 'e61a2e3f-af91-4958-a423-f35d7dbef229', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'resources' on Instance uuid 3b74e50d-0c81-4c84-a97a-2e22a0524a93 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'numa_topology' on Instance uuid 3b74e50d-0c81-4c84-a97a-2e22a0524a93 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:07:36 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:07:36 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b74e50d-0c81-4c84-a97a-2e22a0524a93 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCxnpyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:07:36 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:07:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:07:36 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:07:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:07:36 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[546d640e-9b0e-4d14-938f-2cbe595aece7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = dCxnpyJT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 11 22:07:36 user nova-compute[71364]: node.name = iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba
Apr 11 22:07:36 user nova-compute[71364]: node.tpgt = -1
Apr 11 22:07:36 user nova-compute[71364]: node.startup = automatic
Apr 11 22:07:36 user nova-compute[71364]: node.leading_login = No
Apr 11 22:07:36 user nova-compute[71364]: iface.iscsi_ifacename = default
Apr 11 22:07:36 user nova-compute[71364]: iface.net_ifacename = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.ipaddress = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.prefix_len = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.hwaddress = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.transport_name = tcp
Apr 11 22:07:36 user nova-compute[71364]: iface.initiatorname = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.state = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.vlan_id = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.vlan_priority = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.vlan_state = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.iface_num = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.mtu = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.port = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.bootproto = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.subnet_mask = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.gateway = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.dhcp_alt_client_id_state = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.dhcp_alt_client_id = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.dhcp_dns = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.dhcp_learn_iqn = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.dhcp_req_vendor_id_state = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.dhcp_vendor_id_state = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.dhcp_vendor_id = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.dhcp_slp_da = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.fragmentation = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.gratuitous_arp = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.incoming_forwarding = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.tos_state = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.tos = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.ttl = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.delayed_ack = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.tcp_nagle = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.tcp_wsf_state = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.tcp_wsf = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.tcp_timer_scale = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.tcp_timestamp = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.redirect = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.def_task_mgmt_timeout = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.header_digest = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.data_digest = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.immediate_data = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.initial_r2t = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.data_seq_inorder = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.data_pdu_inorder = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.erl = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.max_receive_data_len = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.first_burst_len = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.max_outstanding_r2t = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.max_burst_len = 0
Apr 11 22:07:36 user nova-compute[71364]: iface.chap_auth = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.bidi_chap = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.strict_login_compliance = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.discovery_auth = <empty>
Apr 11 22:07:36 user nova-compute[71364]: iface.discovery_logout = <empty>
Apr 11 22:07:36 user nova-compute[71364]: node.discovery_address = <empty>
Apr 11 22:07:36 user nova-compute[71364]: node.discovery_port = 0
Apr 11 22:07:36 user nova-compute[71364]: node.discovery_type = static
Apr 11 22:07:36 user nova-compute[71364]: node.session.initial_cmdsn = 0
Apr 11 22:07:36 user nova-compute[71364]: node.session.initial_login_retry_max = 8
Apr 11 22:07:36 user nova-compute[71364]: node.session.xmit_thread_priority = -20
Apr 11 22:07:36 user nova-compute[71364]: node.session.cmds_max = 128
Apr 11 22:07:36 user nova-compute[71364]: node.session.queue_depth = 32
Apr 11 22:07:36 user nova-compute[71364]: node.session.nr_sessions = 1
Apr 11 22:07:36 user nova-compute[71364]: node.session.auth.authmethod = CHAP
Apr 11 22:07:36 user nova-compute[71364]: node.session.auth.username = dCxnpyJT
Apr 11 22:07:36 user nova-compute[71364]: node.session.auth.password = ***
Apr 11 22:07:36 user nova-compute[71364]: node.session.auth.username_in = <empty>
Apr 11 22:07:36 user nova-compute[71364]: node.session.auth.password_in = <empty>
Apr 11 22:07:36 user nova-compute[71364]: node.session.auth.chap_algs = MD5
Apr 11 22:07:36 user nova-compute[71364]: node.session.timeo.replacement_timeout = 120
Apr 11 22:07:36 user nova-compute[71364]: node.session.err_timeo.abort_timeout = 15
Apr 11 22:07:36 user nova-compute[71364]: node.session.err_timeo.lu_reset_timeout = 30
Apr 11 22:07:36 user nova-compute[71364]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 11 22:07:36 user nova-compute[71364]: node.session.err_timeo.host_reset_timeout = 60
Apr 11 22:07:36 user nova-compute[71364]: node.session.iscsi.FastAbort = Yes
Apr 11 22:07:36 user nova-compute[71364]: node.session.iscsi.InitialR2T = No
Apr 11 22:07:36 user nova-compute[71364]: node.session.iscsi.ImmediateData = Yes
Apr 11 22:07:36 user nova-compute[71364]: node.session.iscsi.FirstBurstLength = 262144
Apr 11 22:07:36 user nova-compute[71364]: node.session.iscsi.MaxBurstLength = 16776192
Apr 11 22:07:36 user nova-compute[71364]: node.session.iscsi.DefaultTime2Retain = 0
Apr 11 22:07:36 user nova-compute[71364]: node.session.iscsi.DefaultTime2Wait = 2
Apr 11 22:07:36 user nova-compute[71364]: node.session.iscsi.MaxConnections = 1
Apr 11 22:07:36 user nova-compute[71364]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 11 22:07:36 user nova-compute[71364]: node.session.iscsi.ERL = 0
Apr 11 22:07:36 user nova-compute[71364]: node.session.scan = manual
Apr 11 22:07:36 user nova-compute[71364]: node.session.reopen_max = 0
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].address = 172.16.0.220
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].port = 3260
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].startup = manual
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].tcp.window_size = 524288
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].tcp.type_of_service = 0
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].timeo.logout_timeout = 15
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].timeo.login_timeout = 15
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].timeo.auth_timeout = 45
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].timeo.noop_out_interval = 5
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].timeo.noop_out_timeout = 5
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].iscsi.HeaderDigest = None
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].iscsi.DataDigest = None
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].iscsi.IFMarker = No
Apr 11 22:07:36 user nova-compute[71364]: node.conn[0].iscsi.OFMarker = No
Apr 11 22:07:36 user nova-compute[71364]: # END RECORD
Apr 11 22:07:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[57276673-2c2a-4f60-bd56-ac8af33d706d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:07:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[28afa17a-97de-436e-a9af-c453f3789595]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCxnpyJT {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCxnpyJT" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[32df60b1-b167-4ee2-8a41-793c813bf3e2]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dCxnpyJT'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c204db-5ec6-4e16-a824-16f2dca2dada]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a88213-bcce-43de-9592-c10a6554d0ec]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:07:37 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:07:37 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:07:37 user nova-compute[71364]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:07:37 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:07:37 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:07:37 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:07:37 user nova-compute[71364]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:07:37 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.148s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] HCTL ('35', '0', '0', 0) found on session 36 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[289bcc2c-d1c1-4ba3-8168-34082991cd37]: (4, ('0 0 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Searching for a device in session 36 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCxnpyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.173s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] <== connect_volume: return (174ms) {'type': 'block', 'scsi_wwn': '23365356339626531', 'path': '/dev/sdd'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365356339626531', 'path': '/dev/sdd'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-681651975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-681651975',id=32,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:06:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53057a8fc17e400e8c26a7dec2c873f9',ramdisk_id='',reservation_id='r-7bjmu0w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:06:00Z,user_data=None,user_id='10430313a8b44e6794ca88d30a83c69a',uuid=3b74e50d-0c81-4c84-a97a-2e22a0524a93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "vif_mac": "fa:16:3e:60:74:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converting VIF {"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "vif_mac": "fa:16:3e:60:74:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:74:fd,bridge_name='br-int',has_traffic_filtering=True,id=0f82f3bd-eb56-4b1a-aed6-7b4159cc1852,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f82f3bd-eb') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b74e50d-0c81-4c84-a97a-2e22a0524a93 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:07:37 user nova-compute[71364]:   <uuid>3b74e50d-0c81-4c84-a97a-2e22a0524a93</uuid>
Apr 11 22:07:37 user nova-compute[71364]:   <name>instance-00000020</name>
Apr 11 22:07:37 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:07:37 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:07:37 user nova-compute[71364]:   <metadata>
Apr 11 22:07:37 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:07:37 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:07:37 user nova-compute[71364]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-681651975</nova:name>
Apr 11 22:07:37 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:07:36</nova:creationTime>
Apr 11 22:07:37 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:07:37 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:07:37 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:07:37 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:07:37 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:07:37 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:07:37 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:07:37 user nova-compute[71364]:       <nova:owner>
Apr 11 22:07:37 user nova-compute[71364]:         <nova:user uuid="10430313a8b44e6794ca88d30a83c69a">tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member</nova:user>
Apr 11 22:07:37 user nova-compute[71364]:         <nova:project uuid="53057a8fc17e400e8c26a7dec2c873f9">tempest-ServerBootFromVolumeStableRescueTest-1235920472</nova:project>
Apr 11 22:07:37 user nova-compute[71364]:       </nova:owner>
Apr 11 22:07:37 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:07:37 user nova-compute[71364]:       <nova:ports>
Apr 11 22:07:37 user nova-compute[71364]:         <nova:port uuid="0f82f3bd-eb56-4b1a-aed6-7b4159cc1852">
Apr 11 22:07:37 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 22:07:37 user nova-compute[71364]:         </nova:port>
Apr 11 22:07:37 user nova-compute[71364]:       </nova:ports>
Apr 11 22:07:37 user nova-compute[71364]:     </nova:instance>
Apr 11 22:07:37 user nova-compute[71364]:   </metadata>
Apr 11 22:07:37 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:07:37 user nova-compute[71364]:     <system>
Apr 11 22:07:37 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:07:37 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:07:37 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:07:37 user nova-compute[71364]:       <entry name="serial">3b74e50d-0c81-4c84-a97a-2e22a0524a93</entry>
Apr 11 22:07:37 user nova-compute[71364]:       <entry name="uuid">3b74e50d-0c81-4c84-a97a-2e22a0524a93</entry>
Apr 11 22:07:37 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:07:37 user nova-compute[71364]:     </system>
Apr 11 22:07:37 user nova-compute[71364]:   </sysinfo>
Apr 11 22:07:37 user nova-compute[71364]:   <os>
Apr 11 22:07:37 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:07:37 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:07:37 user nova-compute[71364]:   </os>
Apr 11 22:07:37 user nova-compute[71364]:   <features>
Apr 11 22:07:37 user nova-compute[71364]:     <acpi/>
Apr 11 22:07:37 user nova-compute[71364]:     <apic/>
Apr 11 22:07:37 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:07:37 user nova-compute[71364]:   </features>
Apr 11 22:07:37 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:07:37 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:07:37 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:07:37 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:07:37 user nova-compute[71364]:   </clock>
Apr 11 22:07:37 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:07:37 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:07:37 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:07:37 user nova-compute[71364]:   </cpu>
Apr 11 22:07:37 user nova-compute[71364]:   <devices>
Apr 11 22:07:37 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 22:07:37 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:07:37 user nova-compute[71364]:       <source dev="/dev/sdd"/>
Apr 11 22:07:37 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:07:37 user nova-compute[71364]:       <serial>1a70f8fe-561d-4836-b2b4-775fe6e2b4ba</serial>
Apr 11 22:07:37 user nova-compute[71364]:     </disk>
Apr 11 22:07:37 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:07:37 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:07:37 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/disk.rescue"/>
Apr 11 22:07:37 user nova-compute[71364]:       <target dev="vdb" bus="virtio"/>
Apr 11 22:07:37 user nova-compute[71364]:       <boot order="1"/>
Apr 11 22:07:37 user nova-compute[71364]:     </disk>
Apr 11 22:07:37 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:07:37 user nova-compute[71364]:       <mac address="fa:16:3e:60:74:fd"/>
Apr 11 22:07:37 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:07:37 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:07:37 user nova-compute[71364]:       <target dev="tap0f82f3bd-eb"/>
Apr 11 22:07:37 user nova-compute[71364]:     </interface>
Apr 11 22:07:37 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:07:37 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/console.log" append="off"/>
Apr 11 22:07:37 user nova-compute[71364]:     </serial>
Apr 11 22:07:37 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:07:37 user nova-compute[71364]:     <video>
Apr 11 22:07:37 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:07:37 user nova-compute[71364]:     </video>
Apr 11 22:07:37 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:07:37 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:07:37 user nova-compute[71364]:     </rng>
Apr 11 22:07:37 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:07:37 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:07:37 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:07:37 user nova-compute[71364]:     </memballoon>
Apr 11 22:07:37 user nova-compute[71364]:   </devices>
Apr 11 22:07:37 user nova-compute[71364]: </domain>
Apr 11 22:07:37 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:07:37 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Instance destroyed successfully.
Apr 11 22:07:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:07:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] No VIF found with MAC fa:16:3e:60:74:fd, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:07:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG nova.compute.manager [req-6a04010b-8d97-4f78-a5bd-f28b5379979f req-0aac2448-8e71-41df-ba4d-f892ecd905bd service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6a04010b-8d97-4f78-a5bd-f28b5379979f req-0aac2448-8e71-41df-ba4d-f892ecd905bd service nova] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6a04010b-8d97-4f78-a5bd-f28b5379979f req-0aac2448-8e71-41df-ba4d-f892ecd905bd service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6a04010b-8d97-4f78-a5bd-f28b5379979f req-0aac2448-8e71-41df-ba4d-f892ecd905bd service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG nova.compute.manager [req-6a04010b-8d97-4f78-a5bd-f28b5379979f req-0aac2448-8e71-41df-ba4d-f892ecd905bd service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] No waiting events found dispatching network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:07:39 user nova-compute[71364]: WARNING nova.compute.manager [req-6a04010b-8d97-4f78-a5bd-f28b5379979f req-0aac2448-8e71-41df-ba4d-f892ecd905bd service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received unexpected event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance with vm_state active and task_state rescuing.
Apr 11 22:07:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "d6f50e18-5362-4910-9749-4b8122720a2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG nova.compute.manager [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:07:39 user nova-compute[71364]: INFO nova.compute.claims [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Claim successful on node user
Apr 11 22:07:39 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG nova.compute.manager [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG nova.compute.manager [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:07:39 user nova-compute[71364]: DEBUG nova.network.neutron [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.policy [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:07:40 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.compute.manager [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.compute.manager [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:07:40 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Creating image(s)
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "/opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "/opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.150s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.142s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk 1073741824" returned: 0 in 0.054s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.network.neutron [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Successfully created port: 189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for 3b74e50d-0c81-4c84-a97a-2e22a0524a93 due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250860.9289315, 3b74e50d-0c81-4c84-a97a-2e22a0524a93 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:07:40 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] VM Resumed (Lifecycle Event)
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Cannot resize image /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.objects.instance [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'migration_context' on Instance uuid d6f50e18-5362-4910-9749-4b8122720a2f {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Ensure instance console log exists: /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:40 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 11 22:07:40 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250860.9313374, 3b74e50d-0c81-4c84-a97a-2e22a0524a93 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:07:40 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] VM Started (Lifecycle Event)
Apr 11 22:07:41 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:07:41 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:07:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-f4c79875-7f9e-4836-9769-ba2d7992b2a7 req-aa9696f7-942b-4f6c-b0d8-6e3d0f4cba90 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:07:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f4c79875-7f9e-4836-9769-ba2d7992b2a7 req-aa9696f7-942b-4f6c-b0d8-6e3d0f4cba90 service nova] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f4c79875-7f9e-4836-9769-ba2d7992b2a7 req-aa9696f7-942b-4f6c-b0d8-6e3d0f4cba90 service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f4c79875-7f9e-4836-9769-ba2d7992b2a7 req-aa9696f7-942b-4f6c-b0d8-6e3d0f4cba90 service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-f4c79875-7f9e-4836-9769-ba2d7992b2a7 req-aa9696f7-942b-4f6c-b0d8-6e3d0f4cba90 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] No waiting events found dispatching network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:07:41 user nova-compute[71364]: WARNING nova.compute.manager [req-f4c79875-7f9e-4836-9769-ba2d7992b2a7 req-aa9696f7-942b-4f6c-b0d8-6e3d0f4cba90 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received unexpected event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance with vm_state rescued and task_state None.
Apr 11 22:07:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:42 user nova-compute[71364]: DEBUG nova.network.neutron [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Successfully updated port: 189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:07:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "refresh_cache-d6f50e18-5362-4910-9749-4b8122720a2f" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:07:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquired lock "refresh_cache-d6f50e18-5362-4910-9749-4b8122720a2f" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:07:42 user nova-compute[71364]: DEBUG nova.network.neutron [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:07:42 user nova-compute[71364]: DEBUG nova.network.neutron [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.network.neutron [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Updating instance_info_cache with network_info: [{"id": "189a45d4-e65d-4466-9de5-61f14a667d7e", "address": "fa:16:3e:2a:7a:7b", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a45d4-e6", "ovs_interfaceid": "189a45d4-e65d-4466-9de5-61f14a667d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Releasing lock "refresh_cache-d6f50e18-5362-4910-9749-4b8122720a2f" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Instance network_info: |[{"id": "189a45d4-e65d-4466-9de5-61f14a667d7e", "address": "fa:16:3e:2a:7a:7b", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a45d4-e6", "ovs_interfaceid": "189a45d4-e65d-4466-9de5-61f14a667d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Start _get_guest_xml network_info=[{"id": "189a45d4-e65d-4466-9de5-61f14a667d7e", "address": "fa:16:3e:2a:7a:7b", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a45d4-e6", "ovs_interfaceid": "189a45d4-e65d-4466-9de5-61f14a667d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:07:43 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:07:43 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-46710285',display_name='tempest-AttachVolumeTestJSON-server-46710285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-46710285',id=35,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjlELRYqzP7CZz3vqsGQyXpY1mcBXFG5DfukejDbcUqsBk3HCNAb9YE2xJsI/wlGPb6TsDx/yhWhzBSTHbmOEw9jTJunYPpRtn5VbZn6Reg1dl6Jw9odvmHPl4S7+7Naw==',key_name='tempest-keypair-1050830117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5aa35cf81ae74532a074bde65f192848',ramdisk_id='',reservation_id='r-blumh0qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1865595781',owner_user_name='tempest-AttachVolumeTestJSON-1865595781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76211a47ed9b4a8abdeeea98c774d3d7',uuid=d6f50e18-5362-4910-9749-4b8122720a2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "189a45d4-e65d-4466-9de5-61f14a667d7e", "address": "fa:16:3e:2a:7a:7b", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a45d4-e6", "ovs_interfaceid": "189a45d4-e65d-4466-9de5-61f14a667d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converting VIF {"id": "189a45d4-e65d-4466-9de5-61f14a667d7e", "address": "fa:16:3e:2a:7a:7b", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a45d4-e6", "ovs_interfaceid": "189a45d4-e65d-4466-9de5-61f14a667d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7a:7b,bridge_name='br-int',has_traffic_filtering=True,id=189a45d4-e65d-4466-9de5-61f14a667d7e,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189a45d4-e6') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.objects.instance [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'pci_devices' on Instance uuid d6f50e18-5362-4910-9749-4b8122720a2f {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:07:43 user nova-compute[71364]:   <uuid>d6f50e18-5362-4910-9749-4b8122720a2f</uuid>
Apr 11 22:07:43 user nova-compute[71364]:   <name>instance-00000023</name>
Apr 11 22:07:43 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:07:43 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:07:43 user nova-compute[71364]:   <metadata>
Apr 11 22:07:43 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:07:43 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:07:43 user nova-compute[71364]:       <nova:name>tempest-AttachVolumeTestJSON-server-46710285</nova:name>
Apr 11 22:07:43 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:07:43</nova:creationTime>
Apr 11 22:07:43 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:07:43 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:07:43 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:07:43 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:07:43 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:07:43 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:07:43 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:07:43 user nova-compute[71364]:       <nova:owner>
Apr 11 22:07:43 user nova-compute[71364]:         <nova:user uuid="76211a47ed9b4a8abdeeea98c774d3d7">tempest-AttachVolumeTestJSON-1865595781-project-member</nova:user>
Apr 11 22:07:43 user nova-compute[71364]:         <nova:project uuid="5aa35cf81ae74532a074bde65f192848">tempest-AttachVolumeTestJSON-1865595781</nova:project>
Apr 11 22:07:43 user nova-compute[71364]:       </nova:owner>
Apr 11 22:07:43 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:07:43 user nova-compute[71364]:       <nova:ports>
Apr 11 22:07:43 user nova-compute[71364]:         <nova:port uuid="189a45d4-e65d-4466-9de5-61f14a667d7e">
Apr 11 22:07:43 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 22:07:43 user nova-compute[71364]:         </nova:port>
Apr 11 22:07:43 user nova-compute[71364]:       </nova:ports>
Apr 11 22:07:43 user nova-compute[71364]:     </nova:instance>
Apr 11 22:07:43 user nova-compute[71364]:   </metadata>
Apr 11 22:07:43 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:07:43 user nova-compute[71364]:     <system>
Apr 11 22:07:43 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:07:43 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:07:43 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:07:43 user nova-compute[71364]:       <entry name="serial">d6f50e18-5362-4910-9749-4b8122720a2f</entry>
Apr 11 22:07:43 user nova-compute[71364]:       <entry name="uuid">d6f50e18-5362-4910-9749-4b8122720a2f</entry>
Apr 11 22:07:43 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:07:43 user nova-compute[71364]:     </system>
Apr 11 22:07:43 user nova-compute[71364]:   </sysinfo>
Apr 11 22:07:43 user nova-compute[71364]:   <os>
Apr 11 22:07:43 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:07:43 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:07:43 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:07:43 user nova-compute[71364]:   </os>
Apr 11 22:07:43 user nova-compute[71364]:   <features>
Apr 11 22:07:43 user nova-compute[71364]:     <acpi/>
Apr 11 22:07:43 user nova-compute[71364]:     <apic/>
Apr 11 22:07:43 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:07:43 user nova-compute[71364]:   </features>
Apr 11 22:07:43 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:07:43 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:07:43 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:07:43 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:07:43 user nova-compute[71364]:   </clock>
Apr 11 22:07:43 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:07:43 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:07:43 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:07:43 user nova-compute[71364]:   </cpu>
Apr 11 22:07:43 user nova-compute[71364]:   <devices>
Apr 11 22:07:43 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:07:43 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:07:43 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk"/>
Apr 11 22:07:43 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:07:43 user nova-compute[71364]:     </disk>
Apr 11 22:07:43 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:07:43 user nova-compute[71364]:       <mac address="fa:16:3e:2a:7a:7b"/>
Apr 11 22:07:43 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:07:43 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:07:43 user nova-compute[71364]:       <target dev="tap189a45d4-e6"/>
Apr 11 22:07:43 user nova-compute[71364]:     </interface>
Apr 11 22:07:43 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:07:43 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/console.log" append="off"/>
Apr 11 22:07:43 user nova-compute[71364]:     </serial>
Apr 11 22:07:43 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:07:43 user nova-compute[71364]:     <video>
Apr 11 22:07:43 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:07:43 user nova-compute[71364]:     </video>
Apr 11 22:07:43 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:07:43 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:07:43 user nova-compute[71364]:     </rng>
Apr 11 22:07:43 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:07:43 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:07:43 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:07:43 user nova-compute[71364]:     </memballoon>
Apr 11 22:07:43 user nova-compute[71364]:   </devices>
Apr 11 22:07:43 user nova-compute[71364]: </domain>
Apr 11 22:07:43 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-46710285',display_name='tempest-AttachVolumeTestJSON-server-46710285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-46710285',id=35,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjlELRYqzP7CZz3vqsGQyXpY1mcBXFG5DfukejDbcUqsBk3HCNAb9YE2xJsI/wlGPb6TsDx/yhWhzBSTHbmOEw9jTJunYPpRtn5VbZn6Reg1dl6Jw9odvmHPl4S7+7Naw==',key_name='tempest-keypair-1050830117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5aa35cf81ae74532a074bde65f192848',ramdisk_id='',reservation_id='r-blumh0qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1865595781',owner_user_name='tempest-AttachVolumeTestJSON-1865595781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:07:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76211a47ed9b4a8abdeeea98c774d3d7',uuid=d6f50e18-5362-4910-9749-4b8122720a2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "189a45d4-e65d-4466-9de5-61f14a667d7e", "address": "fa:16:3e:2a:7a:7b", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a45d4-e6", "ovs_interfaceid": "189a45d4-e65d-4466-9de5-61f14a667d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converting VIF {"id": "189a45d4-e65d-4466-9de5-61f14a667d7e", "address": "fa:16:3e:2a:7a:7b", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a45d4-e6", "ovs_interfaceid": "189a45d4-e65d-4466-9de5-61f14a667d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7a:7b,bridge_name='br-int',has_traffic_filtering=True,id=189a45d4-e65d-4466-9de5-61f14a667d7e,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189a45d4-e6') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG os_vif [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7a:7b,bridge_name='br-int',has_traffic_filtering=True,id=189a45d4-e65d-4466-9de5-61f14a667d7e,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189a45d4-e6') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap189a45d4-e6, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap189a45d4-e6, col_values=(('external_ids', {'iface-id': '189a45d4-e65d-4466-9de5-61f14a667d7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:7a:7b', 'vm-uuid': 'd6f50e18-5362-4910-9749-4b8122720a2f'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:43 user nova-compute[71364]: INFO os_vif [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:7a:7b,bridge_name='br-int',has_traffic_filtering=True,id=189a45d4-e65d-4466-9de5-61f14a667d7e,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189a45d4-e6')
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.compute.manager [req-ec2ac2f6-42f9-46fc-b243-bf2b4d3c0d42 req-f5228354-8fe6-48a9-9d80-c563c60ae302 service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Received event network-changed-189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.compute.manager [req-ec2ac2f6-42f9-46fc-b243-bf2b4d3c0d42 req-f5228354-8fe6-48a9-9d80-c563c60ae302 service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Refreshing instance network info cache due to event network-changed-189a45d4-e65d-4466-9de5-61f14a667d7e. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ec2ac2f6-42f9-46fc-b243-bf2b4d3c0d42 req-f5228354-8fe6-48a9-9d80-c563c60ae302 service nova] Acquiring lock "refresh_cache-d6f50e18-5362-4910-9749-4b8122720a2f" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ec2ac2f6-42f9-46fc-b243-bf2b4d3c0d42 req-f5228354-8fe6-48a9-9d80-c563c60ae302 service nova] Acquired lock "refresh_cache-d6f50e18-5362-4910-9749-4b8122720a2f" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.network.neutron [req-ec2ac2f6-42f9-46fc-b243-bf2b4d3c0d42 req-f5228354-8fe6-48a9-9d80-c563c60ae302 service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Refreshing network info cache for port 189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] No VIF found with MAC fa:16:3e:2a:7a:7b, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.network.neutron [req-ec2ac2f6-42f9-46fc-b243-bf2b4d3c0d42 req-f5228354-8fe6-48a9-9d80-c563c60ae302 service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Updated VIF entry in instance network info cache for port 189a45d4-e65d-4466-9de5-61f14a667d7e. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG nova.network.neutron [req-ec2ac2f6-42f9-46fc-b243-bf2b4d3c0d42 req-f5228354-8fe6-48a9-9d80-c563c60ae302 service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Updating instance_info_cache with network_info: [{"id": "189a45d4-e65d-4466-9de5-61f14a667d7e", "address": "fa:16:3e:2a:7a:7b", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a45d4-e6", "ovs_interfaceid": "189a45d4-e65d-4466-9de5-61f14a667d7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:07:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ec2ac2f6-42f9-46fc-b243-bf2b4d3c0d42 req-f5228354-8fe6-48a9-9d80-c563c60ae302 service nova] Releasing lock "refresh_cache-d6f50e18-5362-4910-9749-4b8122720a2f" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:07:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-269b77fe-cf1f-4808-afb1-aed718cbaa9f req-c7d2e17a-5605-488a-8fa4-e63ca16c7c30 service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Received event network-vif-plugged-189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:07:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-269b77fe-cf1f-4808-afb1-aed718cbaa9f req-c7d2e17a-5605-488a-8fa4-e63ca16c7c30 service nova] Acquiring lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-269b77fe-cf1f-4808-afb1-aed718cbaa9f req-c7d2e17a-5605-488a-8fa4-e63ca16c7c30 service nova] Lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-269b77fe-cf1f-4808-afb1-aed718cbaa9f req-c7d2e17a-5605-488a-8fa4-e63ca16c7c30 service nova] Lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-269b77fe-cf1f-4808-afb1-aed718cbaa9f req-c7d2e17a-5605-488a-8fa4-e63ca16c7c30 service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] No waiting events found dispatching network-vif-plugged-189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:07:44 user nova-compute[71364]: WARNING nova.compute.manager [req-269b77fe-cf1f-4808-afb1-aed718cbaa9f req-c7d2e17a-5605-488a-8fa4-e63ca16c7c30 service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Received unexpected event network-vif-plugged-189a45d4-e65d-4466-9de5-61f14a667d7e for instance with vm_state building and task_state spawning.
Apr 11 22:07:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250866.9261508, d6f50e18-5362-4910-9749-4b8122720a2f => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:07:46 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] VM Resumed (Lifecycle Event)
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.compute.manager [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:07:46 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Instance spawned successfully.
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:07:46 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250866.9295695, d6f50e18-5362-4910-9749-4b8122720a2f => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:07:46 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] VM Started (Lifecycle Event)
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.compute.manager [req-8dcb9328-bc61-4183-9be3-305b92e074b6 req-b1d5b845-8c0c-4e66-9501-343b035f1ae7 service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Received event network-vif-plugged-189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8dcb9328-bc61-4183-9be3-305b92e074b6 req-b1d5b845-8c0c-4e66-9501-343b035f1ae7 service nova] Acquiring lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8dcb9328-bc61-4183-9be3-305b92e074b6 req-b1d5b845-8c0c-4e66-9501-343b035f1ae7 service nova] Lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8dcb9328-bc61-4183-9be3-305b92e074b6 req-b1d5b845-8c0c-4e66-9501-343b035f1ae7 service nova] Lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.compute.manager [req-8dcb9328-bc61-4183-9be3-305b92e074b6 req-b1d5b845-8c0c-4e66-9501-343b035f1ae7 service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] No waiting events found dispatching network-vif-plugged-189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:07:46 user nova-compute[71364]: WARNING nova.compute.manager [req-8dcb9328-bc61-4183-9be3-305b92e074b6 req-b1d5b845-8c0c-4e66-9501-343b035f1ae7 service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Received unexpected event network-vif-plugged-189a45d4-e65d-4466-9de5-61f14a667d7e for instance with vm_state building and task_state spawning.
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:07:46 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:07:47 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:07:47 user nova-compute[71364]: INFO nova.compute.manager [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Took 6.78 seconds to spawn the instance on the hypervisor.
Apr 11 22:07:47 user nova-compute[71364]: DEBUG nova.compute.manager [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:07:47 user nova-compute[71364]: INFO nova.compute.manager [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Took 7.74 seconds to build instance.
Apr 11 22:07:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.833s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:07:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:07:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:01 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/disk.rescue --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:05 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:08:05 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:08:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7808MB free_disk=26.016128540039062GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d6268190-2187-4596-9f0b-026c520e5c67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b485c9c2-8fb4-4690-af26-ddfae00d5024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c564e327-b508-4b88-a393-e30a166ac848 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d6f50e18-5362-4910-9749-4b8122720a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:08:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:08:06 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:08:06 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:08:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:08:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.490s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-d6268190-2187-4596-9f0b-026c520e5c67" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-d6268190-2187-4596-9f0b-026c520e5c67" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Updating instance_info_cache with network_info: [{"id": "44ef8405-caf6-4408-985a-654d964ae175", "address": "fa:16:3e:0d:e3:24", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44ef8405-ca", "ovs_interfaceid": "44ef8405-caf6-4408-985a-654d964ae175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-d6268190-2187-4596-9f0b-026c520e5c67" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-1a2ffb1b-4fd8-404f-b45c-987dd604dc4d req-3a64f3d0-cb46-4171-bada-7a2d7c628f7d service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Received event network-changed-184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-1a2ffb1b-4fd8-404f-b45c-987dd604dc4d req-3a64f3d0-cb46-4171-bada-7a2d7c628f7d service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Refreshing instance network info cache due to event network-changed-184fffcb-758c-4ac6-afbd-b3d27a38f374. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a2ffb1b-4fd8-404f-b45c-987dd604dc4d req-3a64f3d0-cb46-4171-bada-7a2d7c628f7d service nova] Acquiring lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a2ffb1b-4fd8-404f-b45c-987dd604dc4d req-3a64f3d0-cb46-4171-bada-7a2d7c628f7d service nova] Acquired lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:08:08 user nova-compute[71364]: DEBUG nova.network.neutron [req-1a2ffb1b-4fd8-404f-b45c-987dd604dc4d req-3a64f3d0-cb46-4171-bada-7a2d7c628f7d service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Refreshing network info cache for port 184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:08:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:09 user nova-compute[71364]: DEBUG nova.network.neutron [req-1a2ffb1b-4fd8-404f-b45c-987dd604dc4d req-3a64f3d0-cb46-4171-bada-7a2d7c628f7d service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Updated VIF entry in instance network info cache for port 184fffcb-758c-4ac6-afbd-b3d27a38f374. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:08:09 user nova-compute[71364]: DEBUG nova.network.neutron [req-1a2ffb1b-4fd8-404f-b45c-987dd604dc4d req-3a64f3d0-cb46-4171-bada-7a2d7c628f7d service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Updating instance_info_cache with network_info: [{"id": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "address": "fa:16:3e:89:4e:e1", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184fffcb-75", "ovs_interfaceid": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:08:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a2ffb1b-4fd8-404f-b45c-987dd604dc4d req-3a64f3d0-cb46-4171-bada-7a2d7c628f7d service nova] Releasing lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:08:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Stashing vm_state: active {{(pid=71364) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 11 22:08:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:08:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:08:10 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'pci_requests' on Instance uuid ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:08:10 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:08:10 user nova-compute[71364]: INFO nova.compute.claims [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Claim successful on node user
Apr 11 22:08:10 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'resources' on Instance uuid ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:08:10 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'pci_devices' on Instance uuid ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:08:10 user nova-compute[71364]: INFO nova.compute.resource_tracker [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Updating resource usage from migration 2e306164-a391-4e86-ad79-9ec93af8a716
Apr 11 22:08:10 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:08:10 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:08:10 user nova-compute[71364]: DEBUG nova.compute.manager [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received event network-changed-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:08:10 user nova-compute[71364]: DEBUG nova.compute.manager [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Refreshing instance network info cache due to event network-changed-b0b481ae-0b9d-4aac-ad21-f165acd47d15. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:08:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] Acquiring lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:08:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] Acquired lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:08:10 user nova-compute[71364]: DEBUG nova.network.neutron [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Refreshing network info cache for port b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:08:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.448s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:08:10 user nova-compute[71364]: INFO nova.compute.manager [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Migrating
Apr 11 22:08:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:08:11 user nova-compute[71364]: DEBUG nova.network.neutron [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Updated VIF entry in instance network info cache for port b0b481ae-0b9d-4aac-ad21-f165acd47d15. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:08:11 user nova-compute[71364]: DEBUG nova.network.neutron [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Updating instance_info_cache with network_info: [{"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:08:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] Releasing lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:08:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquired lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:08:11 user nova-compute[71364]: DEBUG nova.network.neutron [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:08:11 user nova-compute[71364]: DEBUG nova.network.neutron [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Updating instance_info_cache with network_info: [{"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:08:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Releasing lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Starting migrate_disk_and_power_off {{(pid=71364) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG nova.compute.manager [req-5be3cac3-7be3-4c46-9870-c000060d32c1 req-9059377e-7c02-4f54-8a70-7b1772d5aee1 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received event network-vif-unplugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5be3cac3-7be3-4c46-9870-c000060d32c1 req-9059377e-7c02-4f54-8a70-7b1772d5aee1 service nova] Acquiring lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5be3cac3-7be3-4c46-9870-c000060d32c1 req-9059377e-7c02-4f54-8a70-7b1772d5aee1 service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5be3cac3-7be3-4c46-9870-c000060d32c1 req-9059377e-7c02-4f54-8a70-7b1772d5aee1 service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG nova.compute.manager [req-5be3cac3-7be3-4c46-9870-c000060d32c1 req-9059377e-7c02-4f54-8a70-7b1772d5aee1 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] No waiting events found dispatching network-vif-unplugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:08:12 user nova-compute[71364]: WARNING nova.compute.manager [req-5be3cac3-7be3-4c46-9870-c000060d32c1 req-9059377e-7c02-4f54-8a70-7b1772d5aee1 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received unexpected event network-vif-unplugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance with vm_state active and task_state resize_migrating.
Apr 11 22:08:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:12 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Instance destroyed successfully.
Apr 11 22:08:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1084422016',display_name='tempest-ServerActionsTestJSON-server-1084422016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1084422016',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:06:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-3j4bwdo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:08:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1222517197-network", "vif_mac": "fa:16:3e:40:36:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1222517197-network", "vif_mac": "fa:16:3e:40:36:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:36:11,bridge_name='br-int',has_traffic_filtering=True,id=b0b481ae-0b9d-4aac-ad21-f165acd47d15,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b481ae-0b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG os_vif [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:36:11,bridge_name='br-int',has_traffic_filtering=True,id=b0b481ae-0b9d-4aac-ad21-f165acd47d15,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b481ae-0b') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0b481ae-0b, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:08:12 user nova-compute[71364]: INFO os_vif [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:36:11,bridge_name='br-int',has_traffic_filtering=True,id=b0b481ae-0b9d-4aac-ad21-f165acd47d15,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b481ae-0b')
Apr 11 22:08:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuEmJKle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:08:12 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:08:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[68860a3c-55f1-4231-93ad-1d9445001d96]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:08:12 user nova-compute[71364]: No targets found.
Apr 11 22:08:12 user nova-compute[71364]: iSNS:
Apr 11 22:08:12 user nova-compute[71364]: No targets found.
Apr 11 22:08:12 user nova-compute[71364]: STATIC:
Apr 11 22:08:12 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:08:12 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:08:12 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:08:12 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa
Apr 11 22:08:12 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:08:12 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:08:12 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba
Apr 11 22:08:12 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:08:12 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:08:12 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c
Apr 11 22:08:12 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:08:12 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:08:12 user nova-compute[71364]: FIRMWARE:
Apr 11 22:08:12 user nova-compute[71364]: No targets found.
Apr 11 22:08:12 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:08:12 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:08:12 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c79a947-71f1-4ce3-8e17-9e6184ad92e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d630d9-d9ba-4af2-ae36-87dfff3f5b5a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:08:12 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:08:12 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:08:12 user nova-compute[71364]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:08:12 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:08:12 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:08:12 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:08:12 user nova-compute[71364]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:08:12 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacd880d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c'): ({'sde'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Removing single pathed devices sde {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b731443-7d27-4d04-a910-fbf597d13576]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd36cd80-2f76-4706-9d6c-e0a4a5d84529]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flushing IO for device /dev/sde {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d97fb4f-65ac-46af-b890-7f836c7e545f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:08:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21827cd-85eb-48ac-99f9-8c98b10d888e]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[79780fbe-38a9-49e6-807b-c0c59ffd6441]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed025f8-3d82-46d6-882a-10d9643df87f]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260]
Apr 11 22:08:13 user nova-compute[71364]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260] successful.
Apr 11 22:08:13 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d470fbd-96fb-4984-a829-c7b2ca09b83b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== disconnect_volume: return (353ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:08:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Port b0b481ae-0b9d-4aac-ad21-f165acd47d15 binding to destination host user is already ACTIVE {{(pid=71364) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG nova.compute.manager [req-b44948c8-afd1-43a7-9d06-c2c3666abdef req-aca0d242-fffc-492d-afe3-72100f017e6f service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received event network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b44948c8-afd1-43a7-9d06-c2c3666abdef req-aca0d242-fffc-492d-afe3-72100f017e6f service nova] Acquiring lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b44948c8-afd1-43a7-9d06-c2c3666abdef req-aca0d242-fffc-492d-afe3-72100f017e6f service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b44948c8-afd1-43a7-9d06-c2c3666abdef req-aca0d242-fffc-492d-afe3-72100f017e6f service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG nova.compute.manager [req-b44948c8-afd1-43a7-9d06-c2c3666abdef req-aca0d242-fffc-492d-afe3-72100f017e6f service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] No waiting events found dispatching network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:08:14 user nova-compute[71364]: WARNING nova.compute.manager [req-b44948c8-afd1-43a7-9d06-c2c3666abdef req-aca0d242-fffc-492d-afe3-72100f017e6f service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received unexpected event network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance with vm_state active and task_state resize_migrated.
Apr 11 22:08:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquired lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Updating instance_info_cache with network_info: [{"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Releasing lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG os_brick.utils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc853e80-a355-4c0a-b52e-3c05733d701d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3fcde2-2e1d-472a-bdec-e19c03916e63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[10001dfa-975a-46e9-96be-c847621cc052]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c3faff-07e8-43f0-ba66-cfa00c03e093]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:08:15 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:08:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:08:15 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:08:15 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96d5d5a-e89d-41f4-adc6-1b28ed829d96]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:15 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:08:15 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:08:15 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:08:15 user nova-compute[71364]: DEBUG os_brick.utils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:08:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Starting finish_migration {{(pid=71364) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Instance directory exists: not creating {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 11 22:08:19 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Creating image(s)
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Ensure instance console log exists: /opt/stack/data/nova/instances/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Start _get_guest_xml network_info=[{"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1222517197-network", "vif_mac": "fa:16:3e:40:36:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuEmJKle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d', 'attached_at': '2023-04-11T22:08:19.000000', 'detached_at': '', 'volume_id': '68c0a458-6bd5-45d6-b87b-1d992e32f75c', 'serial': '68c0a458-6bd5-45d6-b87b-1d992e32f75c'}, 'attachment_id': 'b8306835-3ceb-4d43-b899-117f5ad31fa2', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:08:19 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:08:19 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'vcpu_model' on Instance uuid ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuEmJKle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:08:19 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:08:19 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:08:19 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec17575-b123-4f98-85a1-9bafe29186b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:08:19 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2728538f-1f98-4999-96fb-38d3cd33fb83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c] added
Apr 11 22:08:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[49eda098-0466-48b0-8d0f-1f7bc6898473]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c80fd1-f790-4527-9d12-da031f171ee6]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BuEmJKle {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BuEmJKle" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6267e54e-19f9-442b-bb68-70e5aadc9e69]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BuEmJKle'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fbc7a7-da95-48d8-a2cd-0bbaa478bc72]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[700b4edf-eaf8-411f-9f59-75f3dd921772]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:08:19 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:08:19 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:08:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:08:19 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:08:19 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:08:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b6b6e3-e9f4-4cfc-9f5e-d99206607e24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260]
Apr 11 22:08:19 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260] successful.
Apr 11 22:08:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[242070c1-aa9d-474b-bcba-b702adaf8c7f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c9d9e7-b961-4893-8531-3cd80969221b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:08:19 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:08:19 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:08:19 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:08:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:08:19 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:08:19 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:08:19 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:08:19 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38c420e-ecc6-47d7-8701-d60ce5c7813f]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:08:19 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuEmJKle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23264323531383164', 'path': '/dev/sde'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264323531383164', 'path': '/dev/sde'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1084422016',display_name='tempest-ServerActionsTestJSON-server-1084422016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1084422016',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:06:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-3j4bwdo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:08:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1222517197-network", "vif_mac": "fa:16:3e:40:36:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1222517197-network", "vif_mac": "fa:16:3e:40:36:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:36:11,bridge_name='br-int',has_traffic_filtering=True,id=b0b481ae-0b9d-4aac-ad21-f165acd47d15,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b481ae-0b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:08:20 user nova-compute[71364]:   <uuid>ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d</uuid>
Apr 11 22:08:20 user nova-compute[71364]:   <name>instance-00000021</name>
Apr 11 22:08:20 user nova-compute[71364]:   <memory>196608</memory>
Apr 11 22:08:20 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:08:20 user nova-compute[71364]:   <metadata>
Apr 11 22:08:20 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:08:20 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:08:20 user nova-compute[71364]:       <nova:name>tempest-ServerActionsTestJSON-server-1084422016</nova:name>
Apr 11 22:08:20 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:08:19</nova:creationTime>
Apr 11 22:08:20 user nova-compute[71364]:       <nova:flavor name="m1.micro">
Apr 11 22:08:20 user nova-compute[71364]:         <nova:memory>192</nova:memory>
Apr 11 22:08:20 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:08:20 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:08:20 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:08:20 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:08:20 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:08:20 user nova-compute[71364]:       <nova:owner>
Apr 11 22:08:20 user nova-compute[71364]:         <nova:user uuid="939785ef89cb491aae3df4f411b2543d">tempest-ServerActionsTestJSON-434853204-project-member</nova:user>
Apr 11 22:08:20 user nova-compute[71364]:         <nova:project uuid="c9fff7d112a94e7da6bf166a6f628fed">tempest-ServerActionsTestJSON-434853204</nova:project>
Apr 11 22:08:20 user nova-compute[71364]:       </nova:owner>
Apr 11 22:08:20 user nova-compute[71364]:       <nova:ports>
Apr 11 22:08:20 user nova-compute[71364]:         <nova:port uuid="b0b481ae-0b9d-4aac-ad21-f165acd47d15">
Apr 11 22:08:20 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 11 22:08:20 user nova-compute[71364]:         </nova:port>
Apr 11 22:08:20 user nova-compute[71364]:       </nova:ports>
Apr 11 22:08:20 user nova-compute[71364]:     </nova:instance>
Apr 11 22:08:20 user nova-compute[71364]:   </metadata>
Apr 11 22:08:20 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:08:20 user nova-compute[71364]:     <system>
Apr 11 22:08:20 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:08:20 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:08:20 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:08:20 user nova-compute[71364]:       <entry name="serial">ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d</entry>
Apr 11 22:08:20 user nova-compute[71364]:       <entry name="uuid">ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d</entry>
Apr 11 22:08:20 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:08:20 user nova-compute[71364]:     </system>
Apr 11 22:08:20 user nova-compute[71364]:   </sysinfo>
Apr 11 22:08:20 user nova-compute[71364]:   <os>
Apr 11 22:08:20 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:08:20 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:08:20 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:08:20 user nova-compute[71364]:   </os>
Apr 11 22:08:20 user nova-compute[71364]:   <features>
Apr 11 22:08:20 user nova-compute[71364]:     <acpi/>
Apr 11 22:08:20 user nova-compute[71364]:     <apic/>
Apr 11 22:08:20 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:08:20 user nova-compute[71364]:   </features>
Apr 11 22:08:20 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:08:20 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:08:20 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:08:20 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:08:20 user nova-compute[71364]:   </clock>
Apr 11 22:08:20 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:08:20 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:08:20 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:08:20 user nova-compute[71364]:   </cpu>
Apr 11 22:08:20 user nova-compute[71364]:   <devices>
Apr 11 22:08:20 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 22:08:20 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:08:20 user nova-compute[71364]:       <source dev="/dev/sde"/>
Apr 11 22:08:20 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:08:20 user nova-compute[71364]:       <serial>68c0a458-6bd5-45d6-b87b-1d992e32f75c</serial>
Apr 11 22:08:20 user nova-compute[71364]:     </disk>
Apr 11 22:08:20 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:08:20 user nova-compute[71364]:       <mac address="fa:16:3e:40:36:11"/>
Apr 11 22:08:20 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:08:20 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:08:20 user nova-compute[71364]:       <target dev="tapb0b481ae-0b"/>
Apr 11 22:08:20 user nova-compute[71364]:     </interface>
Apr 11 22:08:20 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:08:20 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d/console.log" append="off"/>
Apr 11 22:08:20 user nova-compute[71364]:     </serial>
Apr 11 22:08:20 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:08:20 user nova-compute[71364]:     <video>
Apr 11 22:08:20 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:08:20 user nova-compute[71364]:     </video>
Apr 11 22:08:20 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:08:20 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:08:20 user nova-compute[71364]:     </rng>
Apr 11 22:08:20 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:08:20 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:08:20 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:08:20 user nova-compute[71364]:     </memballoon>
Apr 11 22:08:20 user nova-compute[71364]:   </devices>
Apr 11 22:08:20 user nova-compute[71364]: </domain>
Apr 11 22:08:20 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1084422016',display_name='tempest-ServerActionsTestJSON-server-1084422016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1084422016',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:06:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-3j4bwdo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:08:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1222517197-network", "vif_mac": "fa:16:3e:40:36:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1222517197-network", "vif_mac": "fa:16:3e:40:36:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:36:11,bridge_name='br-int',has_traffic_filtering=True,id=b0b481ae-0b9d-4aac-ad21-f165acd47d15,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b481ae-0b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG os_vif [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:36:11,bridge_name='br-int',has_traffic_filtering=True,id=b0b481ae-0b9d-4aac-ad21-f165acd47d15,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b481ae-0b') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0b481ae-0b, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0b481ae-0b, col_values=(('external_ids', {'iface-id': 'b0b481ae-0b9d-4aac-ad21-f165acd47d15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:36:11', 'vm-uuid': 'ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:20 user nova-compute[71364]: INFO os_vif [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:36:11,bridge_name='br-int',has_traffic_filtering=True,id=b0b481ae-0b9d-4aac-ad21-f165acd47d15,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b481ae-0b')
Apr 11 22:08:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:08:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] No VIF found with MAC fa:16:3e:40:36:11, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:08:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-2c1520ba-8bff-4422-b770-671b83ed50d4 req-60aebba5-8fb5-45b1-8a36-53022c766715 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received event network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:08:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2c1520ba-8bff-4422-b770-671b83ed50d4 req-60aebba5-8fb5-45b1-8a36-53022c766715 service nova] Acquiring lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:08:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2c1520ba-8bff-4422-b770-671b83ed50d4 req-60aebba5-8fb5-45b1-8a36-53022c766715 service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:08:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2c1520ba-8bff-4422-b770-671b83ed50d4 req-60aebba5-8fb5-45b1-8a36-53022c766715 service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:08:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-2c1520ba-8bff-4422-b770-671b83ed50d4 req-60aebba5-8fb5-45b1-8a36-53022c766715 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] No waiting events found dispatching network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:08:22 user nova-compute[71364]: WARNING nova.compute.manager [req-2c1520ba-8bff-4422-b770-671b83ed50d4 req-60aebba5-8fb5-45b1-8a36-53022c766715 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received unexpected event network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance with vm_state active and task_state resize_finish.
Apr 11 22:08:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-a4bb42b5-5ae4-4d87-b4fa-7f5d9b5c88ad req-af004ac2-2949-498e-a1ad-2f25146890b5 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received event network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:08:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a4bb42b5-5ae4-4d87-b4fa-7f5d9b5c88ad req-af004ac2-2949-498e-a1ad-2f25146890b5 service nova] Acquiring lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:08:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a4bb42b5-5ae4-4d87-b4fa-7f5d9b5c88ad req-af004ac2-2949-498e-a1ad-2f25146890b5 service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:08:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a4bb42b5-5ae4-4d87-b4fa-7f5d9b5c88ad req-af004ac2-2949-498e-a1ad-2f25146890b5 service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:08:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-a4bb42b5-5ae4-4d87-b4fa-7f5d9b5c88ad req-af004ac2-2949-498e-a1ad-2f25146890b5 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] No waiting events found dispatching network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:08:24 user nova-compute[71364]: WARNING nova.compute.manager [req-a4bb42b5-5ae4-4d87-b4fa-7f5d9b5c88ad req-af004ac2-2949-498e-a1ad-2f25146890b5 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received unexpected event network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance with vm_state active and task_state resize_finish.
Apr 11 22:08:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 22:08:24 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250904.2811112, ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:08:24 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] VM Resumed (Lifecycle Event)
Apr 11 22:08:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:08:24 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Instance running successfully.
Apr 11 22:08:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Failed to set time: agent not configured {{(pid=71364) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 11 22:08:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] finish_migration finished successfully. {{(pid=71364) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 11 22:08:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:08:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:08:24 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 22:08:24 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250904.2821033, ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:08:24 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] VM Started (Lifecycle Event)
Apr 11 22:08:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:08:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:08:24 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 11 22:08:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:08:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-21654cfe-0278-44d6-a317-07346435fcce req-f17e6fa3-7561-48c8-8bcf-a164163327bb service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Received event network-changed-379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:08:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-21654cfe-0278-44d6-a317-07346435fcce req-f17e6fa3-7561-48c8-8bcf-a164163327bb service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Refreshing instance network info cache due to event network-changed-379495b1-9aee-4d67-8b10-517792434e1b. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:08:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-21654cfe-0278-44d6-a317-07346435fcce req-f17e6fa3-7561-48c8-8bcf-a164163327bb service nova] Acquiring lock "refresh_cache-c564e327-b508-4b88-a393-e30a166ac848" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:08:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-21654cfe-0278-44d6-a317-07346435fcce req-f17e6fa3-7561-48c8-8bcf-a164163327bb service nova] Acquired lock "refresh_cache-c564e327-b508-4b88-a393-e30a166ac848" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:08:42 user nova-compute[71364]: DEBUG nova.network.neutron [req-21654cfe-0278-44d6-a317-07346435fcce req-f17e6fa3-7561-48c8-8bcf-a164163327bb service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Refreshing network info cache for port 379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:08:42 user nova-compute[71364]: DEBUG nova.network.neutron [req-21654cfe-0278-44d6-a317-07346435fcce req-f17e6fa3-7561-48c8-8bcf-a164163327bb service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Updated VIF entry in instance network info cache for port 379495b1-9aee-4d67-8b10-517792434e1b. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:08:42 user nova-compute[71364]: DEBUG nova.network.neutron [req-21654cfe-0278-44d6-a317-07346435fcce req-f17e6fa3-7561-48c8-8bcf-a164163327bb service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Updating instance_info_cache with network_info: [{"id": "379495b1-9aee-4d67-8b10-517792434e1b", "address": "fa:16:3e:aa:2c:cf", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap379495b1-9a", "ovs_interfaceid": "379495b1-9aee-4d67-8b10-517792434e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:08:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-21654cfe-0278-44d6-a317-07346435fcce req-f17e6fa3-7561-48c8-8bcf-a164163327bb service nova] Releasing lock "refresh_cache-c564e327-b508-4b88-a393-e30a166ac848" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "c564e327-b508-4b88-a393-e30a166ac848" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "c564e327-b508-4b88-a393-e30a166ac848" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'flavor' on Instance uuid c564e327-b508-4b88-a393-e30a166ac848 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "c564e327-b508-4b88-a393-e30a166ac848" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "c564e327-b508-4b88-a393-e30a166ac848" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "c564e327-b508-4b88-a393-e30a166ac848" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:08:43 user nova-compute[71364]: INFO nova.compute.manager [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Attaching volume a06d6da3-e6a0-48af-8eab-25ac095c8c73 to /dev/vdb
Apr 11 22:08:43 user nova-compute[71364]: DEBUG os_brick.utils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2728bcfd-5022-4fb3-bdc2-8cfd153e13c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a67581-6246-4ac7-8baa-8af346ebcd73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9636b87-59a7-47b0-b735-bf053609d916]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95b1b7e-456b-4044-8e2c-1204f1bb653f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:08:43 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:08:43 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3422687-e69f-401c-b2b2-5ccbb1386135]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG os_brick.utils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:08:43 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Updating existing volume attachment record: e15308d0-114b-492b-b7d3-830de4695773 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:08:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:46 user nova-compute[71364]: DEBUG nova.compute.manager [req-55b5cd6f-d6d3-446c-8f61-76bb541e1e4e req-f90bbaa2-cfc6-4111-b976-bf3caaa0e043 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-changed-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:08:46 user nova-compute[71364]: DEBUG nova.compute.manager [req-55b5cd6f-d6d3-446c-8f61-76bb541e1e4e req-f90bbaa2-cfc6-4111-b976-bf3caaa0e043 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Refreshing instance network info cache due to event network-changed-3b90af5a-ae8d-4876-bda9-002751948bb0. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:08:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-55b5cd6f-d6d3-446c-8f61-76bb541e1e4e req-f90bbaa2-cfc6-4111-b976-bf3caaa0e043 service nova] Acquiring lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:08:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-55b5cd6f-d6d3-446c-8f61-76bb541e1e4e req-f90bbaa2-cfc6-4111-b976-bf3caaa0e043 service nova] Acquired lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:08:46 user nova-compute[71364]: DEBUG nova.network.neutron [req-55b5cd6f-d6d3-446c-8f61-76bb541e1e4e req-f90bbaa2-cfc6-4111-b976-bf3caaa0e043 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Refreshing network info cache for port 3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:08:47 user nova-compute[71364]: INFO nova.compute.manager [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Detaching volume e912cde0-b812-4fb1-a157-b47135188efa
Apr 11 22:08:47 user nova-compute[71364]: INFO nova.virt.block_device [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Attempting to driver detach volume e912cde0-b812-4fb1-a157-b47135188efa from mountpoint /dev/vdb
Apr 11 22:08:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Attempting to detach device vdb from instance b485c9c2-8fb4-4690-af26-ddfae00d5024 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:08:47 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:08:47 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:08:47 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:08:47 user nova-compute[71364]:   <serial>e912cde0-b812-4fb1-a157-b47135188efa</serial>
Apr 11 22:08:47 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:08:47 user nova-compute[71364]: </disk>
Apr 11 22:08:47 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:08:47 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Successfully detached device vdb from instance b485c9c2-8fb4-4690-af26-ddfae00d5024 from the persistent domain config.
Apr 11 22:08:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b485c9c2-8fb4-4690-af26-ddfae00d5024 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:08:47 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:08:47 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:08:47 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:08:47 user nova-compute[71364]:   <serial>e912cde0-b812-4fb1-a157-b47135188efa</serial>
Apr 11 22:08:47 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:08:47 user nova-compute[71364]: </disk>
Apr 11 22:08:47 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG nova.network.neutron [req-55b5cd6f-d6d3-446c-8f61-76bb541e1e4e req-f90bbaa2-cfc6-4111-b976-bf3caaa0e043 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Updated VIF entry in instance network info cache for port 3b90af5a-ae8d-4876-bda9-002751948bb0. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG nova.network.neutron [req-55b5cd6f-d6d3-446c-8f61-76bb541e1e4e req-f90bbaa2-cfc6-4111-b976-bf3caaa0e043 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Updating instance_info_cache with network_info: [{"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-55b5cd6f-d6d3-446c-8f61-76bb541e1e4e req-f90bbaa2-cfc6-4111-b976-bf3caaa0e043 service nova] Releasing lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681250927.7515554, b485c9c2-8fb4-4690-af26-ddfae00d5024 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:08:47 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Successfully detached device vdb from instance b485c9c2-8fb4-4690-af26-ddfae00d5024 from the live domain config.
Apr 11 22:08:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EwvQMABj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:08:47 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d39e4f-c8bb-4adf-ae8f-d1c8e52bed60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:08:47 user nova-compute[71364]: No targets found.
Apr 11 22:08:47 user nova-compute[71364]: iSNS:
Apr 11 22:08:47 user nova-compute[71364]: No targets found.
Apr 11 22:08:47 user nova-compute[71364]: STATIC:
Apr 11 22:08:47 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:08:47 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:08:47 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:08:47 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa
Apr 11 22:08:47 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:08:47 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:08:47 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba
Apr 11 22:08:47 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:08:47 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:08:47 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c
Apr 11 22:08:47 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:08:47 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:08:47 user nova-compute[71364]: FIRMWARE:
Apr 11 22:08:47 user nova-compute[71364]: No targets found.
Apr 11 22:08:47 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:08:47 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:08:47 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[81789a42-6e41-46cf-b0d4-fe870a90a270]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcce372-b74d-4840-9161-97baa0265045]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:08:47 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:08:47 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:08:47 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:08:47 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:08:47 user nova-compute[71364]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa (non-flash)
Apr 11 22:08:47 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:08:47 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:08:47 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff78be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f01afd9-b59d-4409-8148-595acab28320]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bdc879-63c4-4d1d-8aed-3a483fc51749]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3929571b-e6e8-4d1f-a741-81786a6b9780]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d661b8ac-65b4-4b2f-acf7-2cb0a35dac3c]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[08970b04-61ca-4b54-8035-da7141eea6a0]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1590d36-391e-427c-ac37-c0b2421d08c8]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa, portal: 172.16.0.220,3260]
Apr 11 22:08:48 user nova-compute[71364]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa, portal: 172.16.0.220,3260] successful.
Apr 11 22:08:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVbskjhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:08:48 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e912cde0-b812-4fb1-a157-b47135188efa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[005e0af5-f95c-406c-88bd-8a4211b19787]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] <== disconnect_volume: return (324ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.011s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:08:48 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:08:48 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8b88a3-254c-4a6e-bf61-ab4985d89805]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:08:48 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebba48fd-8a99-4d91-bca5-17207c7c19c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73] added
Apr 11 22:08:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a12b8dc-f077-46cc-8e9b-5885d52246c7]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec339b1-1e09-4c9b-b2c3-c53626768765]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVbskjhN {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XVbskjhN" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[22993101-ac17-4e5a-867b-1dcd1c377bd9]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XVbskjhN'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea49519-6b48-4434-ba61-c060557070bb]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90f302f-02bd-4e18-a0d2-397b1c863c4c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:08:48 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:08:48 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:08:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:08:48 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:08:48 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:08:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5bace4-2005-494c-99ab-5552fcaf9724]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73, portal: 172.16.0.220,3260]
Apr 11 22:08:48 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73, portal: 172.16.0.220,3260] successful.
Apr 11 22:08:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0272a00d-a5a5-4e2b-858d-35cc3b1620dc]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f377d5c-4aaf-4542-a4c0-9fe31b6a9e7f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:08:48 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:08:48 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:08:48 user nova-compute[71364]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 (non-flash)
Apr 11 22:08:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:08:48 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:08:48 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:08:48 user nova-compute[71364]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 (non-flash)
Apr 11 22:08:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e3d6a1-2989-45b4-8328-d552d8047879]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVbskjhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'flavor' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-4b3111c2-fd36-41cd-a814-b7502d6bfc7d req-d714dd2d-bca5-41ff-afdc-362c1ca1902a service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-changed-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-4b3111c2-fd36-41cd-a814-b7502d6bfc7d req-d714dd2d-bca5-41ff-afdc-362c1ca1902a service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Refreshing instance network info cache due to event network-changed-3b90af5a-ae8d-4876-bda9-002751948bb0. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4b3111c2-fd36-41cd-a814-b7502d6bfc7d req-d714dd2d-bca5-41ff-afdc-362c1ca1902a service nova] Acquiring lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4b3111c2-fd36-41cd-a814-b7502d6bfc7d req-d714dd2d-bca5-41ff-afdc-362c1ca1902a service nova] Acquired lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG nova.network.neutron [req-4b3111c2-fd36-41cd-a814-b7502d6bfc7d req-d714dd2d-bca5-41ff-afdc-362c1ca1902a service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Refreshing network info cache for port 3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:08:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.677s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:08:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:08:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26238353063613330', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:08:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238353063613330', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:08:49 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'flavor' on Instance uuid c564e327-b508-4b88-a393-e30a166ac848 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:08:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 22:08:49 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:08:49 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:08:49 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:08:49 user nova-compute[71364]:   <serial>a06d6da3-e6a0-48af-8eab-25ac095c8c73</serial>
Apr 11 22:08:49 user nova-compute[71364]: </disk>
Apr 11 22:08:49 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 22:08:49 user nova-compute[71364]: DEBUG nova.network.neutron [req-4b3111c2-fd36-41cd-a814-b7502d6bfc7d req-d714dd2d-bca5-41ff-afdc-362c1ca1902a service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Updated VIF entry in instance network info cache for port 3b90af5a-ae8d-4876-bda9-002751948bb0. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:08:49 user nova-compute[71364]: DEBUG nova.network.neutron [req-4b3111c2-fd36-41cd-a814-b7502d6bfc7d req-d714dd2d-bca5-41ff-afdc-362c1ca1902a service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Updating instance_info_cache with network_info: [{"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:08:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4b3111c2-fd36-41cd-a814-b7502d6bfc7d req-d714dd2d-bca5-41ff-afdc-362c1ca1902a service nova] Releasing lock "refresh_cache-b485c9c2-8fb4-4690-af26-ddfae00d5024" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:08:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:08:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:08:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] No VIF found with MAC fa:16:3e:aa:2c:cf, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:08:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "c564e327-b508-4b88-a393-e30a166ac848" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.172s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:08:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "c564e327-b508-4b88-a393-e30a166ac848" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:08:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "c564e327-b508-4b88-a393-e30a166ac848" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:08:50 user nova-compute[71364]: INFO nova.compute.manager [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Detaching volume a06d6da3-e6a0-48af-8eab-25ac095c8c73
Apr 11 22:08:50 user nova-compute[71364]: INFO nova.virt.block_device [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Attempting to driver detach volume a06d6da3-e6a0-48af-8eab-25ac095c8c73 from mountpoint /dev/vdb
Apr 11 22:08:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Attempting to detach device vdb from instance c564e327-b508-4b88-a393-e30a166ac848 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:08:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:08:50 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:08:50 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:08:50 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:08:50 user nova-compute[71364]:   <serial>a06d6da3-e6a0-48af-8eab-25ac095c8c73</serial>
Apr 11 22:08:50 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:08:50 user nova-compute[71364]: </disk>
Apr 11 22:08:50 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:08:50 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Successfully detached device vdb from instance c564e327-b508-4b88-a393-e30a166ac848 from the persistent domain config.
Apr 11 22:08:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c564e327-b508-4b88-a393-e30a166ac848 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:08:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:08:50 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:08:50 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:08:50 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:08:50 user nova-compute[71364]:   <serial>a06d6da3-e6a0-48af-8eab-25ac095c8c73</serial>
Apr 11 22:08:50 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:08:50 user nova-compute[71364]: </disk>
Apr 11 22:08:50 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:08:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681250931.1052039, c564e327-b508-4b88-a393-e30a166ac848 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c564e327-b508-4b88-a393-e30a166ac848 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:08:51 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Successfully detached device vdb from instance c564e327-b508-4b88-a393-e30a166ac848 from the live domain config.
Apr 11 22:08:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XVbskjhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:08:51 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8bdca0-fa81-407a-8bec-ad0299356be6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:08:51 user nova-compute[71364]: No targets found.
Apr 11 22:08:51 user nova-compute[71364]: iSNS:
Apr 11 22:08:51 user nova-compute[71364]: No targets found.
Apr 11 22:08:51 user nova-compute[71364]: STATIC:
Apr 11 22:08:51 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:08:51 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:08:51 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:08:51 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba
Apr 11 22:08:51 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:08:51 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:08:51 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c
Apr 11 22:08:51 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:08:51 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:08:51 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73
Apr 11 22:08:51 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:08:51 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:08:51 user nova-compute[71364]: FIRMWARE:
Apr 11 22:08:51 user nova-compute[71364]: No targets found.
Apr 11 22:08:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:08:51 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:08:51 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcbcb30-4646-4ec7-b3f6-0ebee716e52b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[593fcdc6-4016-48b6-a99e-99085045fa61]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:08:51 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:08:51 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:08:51 user nova-compute[71364]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 (non-flash)
Apr 11 22:08:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:08:51 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:08:51 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:08:51 user nova-compute[71364]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 (non-flash)
Apr 11 22:08:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacf900d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafbebef-990a-41e2-a8ac-c9ea208dee69]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[92554b6b-b52e-427b-a037-2db612356644]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81a7b4a-5152-44f0-a2e7-bf7366c6407a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe48407-f999-4833-9f0b-abe4ff8ca643]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f852f911-3fec-467b-ba8e-c6b736dd3554]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[366e1f36-642c-421b-a564-9cc94e377503]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73, portal: 172.16.0.220,3260]
Apr 11 22:08:51 user nova-compute[71364]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73, portal: 172.16.0.220,3260] successful.
Apr 11 22:08:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06d6da3-e6a0-48af-8eab-25ac095c8c73 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc82652-5970-42e8-8aef-e1f6e4851124]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] <== disconnect_volume: return (301ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:08:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:08:52 user nova-compute[71364]: DEBUG nova.objects.instance [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'flavor' on Instance uuid c564e327-b508-4b88-a393-e30a166ac848 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:08:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "c564e327-b508-4b88-a393-e30a166ac848" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.646s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:08:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:08:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:01 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:05 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:09:05 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=7751MB free_disk=26.01343536376953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Applying migration context for instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d as it has an incoming, in-progress migration 2e306164-a391-4e86-ad79-9ec93af8a716. Migration status is finished {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 11 22:09:05 user nova-compute[71364]: INFO nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Updating resource usage from migration 2e306164-a391-4e86-ad79-9ec93af8a716
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d6268190-2187-4596-9f0b-026c520e5c67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b485c9c2-8fb4-4690-af26-ddfae00d5024 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c564e327-b508-4b88-a393-e30a166ac848 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d6f50e18-5362-4910-9749-4b8122720a2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Migration 2e306164-a391-4e86-ad79-9ec93af8a716 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=2112MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:09:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:06 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:09:06 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:09:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:09:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG nova.objects.instance [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lazy-loading 'info_cache' on Instance uuid 29e6c78a-dee0-4d28-86cd-debad15718d4 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Updating instance_info_cache with network_info: [{"id": "2e074aaa-933c-4085-ad92-4699f1ac3975", "address": "fa:16:3e:8f:33:19", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e074aaa-93", "ovs_interfaceid": "2e074aaa-933c-4085-ad92-4699f1ac3975", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-29e6c78a-dee0-4d28-86cd-debad15718d4" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:09:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:09:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:24 user nova-compute[71364]: INFO nova.compute.manager [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Unrescuing
Apr 11 22:09:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "refresh_cache-3b74e50d-0c81-4c84-a97a-2e22a0524a93" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:09:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquired lock "refresh_cache-3b74e50d-0c81-4c84-a97a-2e22a0524a93" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:09:24 user nova-compute[71364]: DEBUG nova.network.neutron [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:09:24 user nova-compute[71364]: DEBUG nova.network.neutron [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Updating instance_info_cache with network_info: [{"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:09:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Releasing lock "refresh_cache-3b74e50d-0c81-4c84-a97a-2e22a0524a93" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:09:24 user nova-compute[71364]: DEBUG nova.objects.instance [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'flavor' on Instance uuid 3b74e50d-0c81-4c84-a97a-2e22a0524a93 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:09:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-71c80fc8-ec64-4076-8f97-9ab8f8fe6422 req-c8e8ac87-9fb2-48e3-95dc-8b43422bb17d service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-vif-unplugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:09:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-71c80fc8-ec64-4076-8f97-9ab8f8fe6422 req-c8e8ac87-9fb2-48e3-95dc-8b43422bb17d service nova] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-71c80fc8-ec64-4076-8f97-9ab8f8fe6422 req-c8e8ac87-9fb2-48e3-95dc-8b43422bb17d service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-71c80fc8-ec64-4076-8f97-9ab8f8fe6422 req-c8e8ac87-9fb2-48e3-95dc-8b43422bb17d service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-71c80fc8-ec64-4076-8f97-9ab8f8fe6422 req-c8e8ac87-9fb2-48e3-95dc-8b43422bb17d service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] No waiting events found dispatching network-vif-unplugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:09:25 user nova-compute[71364]: WARNING nova.compute.manager [req-71c80fc8-ec64-4076-8f97-9ab8f8fe6422 req-c8e8ac87-9fb2-48e3-95dc-8b43422bb17d service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received unexpected event network-vif-unplugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:09:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:25 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Instance destroyed successfully.
Apr 11 22:09:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:09:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] No waiting events found dispatching network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:09:27 user nova-compute[71364]: WARNING nova.compute.manager [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received unexpected event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:09:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:09:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] No waiting events found dispatching network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:09:27 user nova-compute[71364]: WARNING nova.compute.manager [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received unexpected event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance with vm_state rescued and task_state unrescuing.
Apr 11 22:09:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for 3b74e50d-0c81-4c84-a97a-2e22a0524a93 due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 22:09:28 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250968.8076103, 3b74e50d-0c81-4c84-a97a-2e22a0524a93 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:09:28 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] VM Resumed (Lifecycle Event)
Apr 11 22:09:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:09:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:09:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:09:28 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 11 22:09:28 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681250968.8117516, 3b74e50d-0c81-4c84-a97a-2e22a0524a93 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:09:28 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] VM Started (Lifecycle Event)
Apr 11 22:09:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:09:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:09:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-f5190415-8c6f-4ba1-b05a-3b3d9f8cd654 req-22839f73-c3bd-421e-be82-398dd101c510 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:09:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f5190415-8c6f-4ba1-b05a-3b3d9f8cd654 req-22839f73-c3bd-421e-be82-398dd101c510 service nova] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f5190415-8c6f-4ba1-b05a-3b3d9f8cd654 req-22839f73-c3bd-421e-be82-398dd101c510 service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f5190415-8c6f-4ba1-b05a-3b3d9f8cd654 req-22839f73-c3bd-421e-be82-398dd101c510 service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:29 user nova-compute[71364]: DEBUG nova.compute.manager [req-f5190415-8c6f-4ba1-b05a-3b3d9f8cd654 req-22839f73-c3bd-421e-be82-398dd101c510 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] No waiting events found dispatching network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:09:29 user nova-compute[71364]: WARNING nova.compute.manager [req-f5190415-8c6f-4ba1-b05a-3b3d9f8cd654 req-22839f73-c3bd-421e-be82-398dd101c510 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received unexpected event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance with vm_state active and task_state None.
Apr 11 22:09:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-f24ee88e-198f-4d11-9ab4-0703f0801c3e req-192b3df1-529c-47e0-845c-1dbe90158f6e service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Received event network-changed-189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:09:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-f24ee88e-198f-4d11-9ab4-0703f0801c3e req-192b3df1-529c-47e0-845c-1dbe90158f6e service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Refreshing instance network info cache due to event network-changed-189a45d4-e65d-4466-9de5-61f14a667d7e. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:09:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f24ee88e-198f-4d11-9ab4-0703f0801c3e req-192b3df1-529c-47e0-845c-1dbe90158f6e service nova] Acquiring lock "refresh_cache-d6f50e18-5362-4910-9749-4b8122720a2f" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:09:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f24ee88e-198f-4d11-9ab4-0703f0801c3e req-192b3df1-529c-47e0-845c-1dbe90158f6e service nova] Acquired lock "refresh_cache-d6f50e18-5362-4910-9749-4b8122720a2f" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:09:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-f24ee88e-198f-4d11-9ab4-0703f0801c3e req-192b3df1-529c-47e0-845c-1dbe90158f6e service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Refreshing network info cache for port 189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:09:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-f24ee88e-198f-4d11-9ab4-0703f0801c3e req-192b3df1-529c-47e0-845c-1dbe90158f6e service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Updated VIF entry in instance network info cache for port 189a45d4-e65d-4466-9de5-61f14a667d7e. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:09:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-f24ee88e-198f-4d11-9ab4-0703f0801c3e req-192b3df1-529c-47e0-845c-1dbe90158f6e service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Updating instance_info_cache with network_info: [{"id": "189a45d4-e65d-4466-9de5-61f14a667d7e", "address": "fa:16:3e:2a:7a:7b", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a45d4-e6", "ovs_interfaceid": "189a45d4-e65d-4466-9de5-61f14a667d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:09:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f24ee88e-198f-4d11-9ab4-0703f0801c3e req-192b3df1-529c-47e0-845c-1dbe90158f6e service nova] Releasing lock "refresh_cache-d6f50e18-5362-4910-9749-4b8122720a2f" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:09:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "d6f50e18-5362-4910-9749-4b8122720a2f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:31 user nova-compute[71364]: DEBUG nova.objects.instance [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'flavor' on Instance uuid d6f50e18-5362-4910-9749-4b8122720a2f {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:09:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "d6f50e18-5362-4910-9749-4b8122720a2f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:32 user nova-compute[71364]: INFO nova.compute.manager [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Attaching volume 5488a5c7-704c-436f-a4f9-5b27d029067a to /dev/vdb
Apr 11 22:09:32 user nova-compute[71364]: DEBUG os_brick.utils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab1b5d9-20ba-48b0-9cc7-332cbcf2d3a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[267244dc-8065-4bfd-9dc2-c11190a826de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c4cc92-a5b4-4159-a762-3b9646a68350]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5927cf9f-7d35-4736-af3d-2f50a20e9e63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:09:32 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:09:32 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ab76a0-8c14-4b02-b6a0-57f056b60607]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG os_brick.utils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:09:32 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Updating existing volume attachment record: 03a53068-6b59-40f9-a9de-88249ba03e42 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:09:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAFHgqer', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:09:36 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:09:36 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:09:36 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f3ed49-06d0-4b7b-81c9-ca086c58d5da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:09:36 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e24f94-d4ce-48d5-ac7d-4e721294bd2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a] added
Apr 11 22:09:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8889eb1f-0ebf-495f-a0c5-dce7a5ae061f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7088eb1-7952-4f46-ab53-b8713cc8b06c]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sAFHgqer {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sAFHgqer" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b2528c-0705-4773-8a26-5ae5e805f0ca]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sAFHgqer'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d45657-8e84-4066-b32b-533faa0a32a6]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e8b679-ad01-4a96-98e2-c1670748e447]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:09:36 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:09:36 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:09:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:09:36 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:09:36 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:09:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1cb06c-0150-43b2-8602-47a7cad16e13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a, portal: 172.16.0.220,3260]
Apr 11 22:09:36 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a, portal: 172.16.0.220,3260] successful.
Apr 11 22:09:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c18e69-880b-4358-b1b8-4ceb0745959b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[052834b8-c6b6-4dca-929e-3ad5d0d89d87]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:09:36 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:09:36 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:09:36 user nova-compute[71364]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a (non-flash)
Apr 11 22:09:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:09:36 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:09:36 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:09:36 user nova-compute[71364]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a (non-flash)
Apr 11 22:09:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5741c8a9-f20f-440c-a91e-77978a2f62cc]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:09:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAFHgqer', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:37 user nova-compute[71364]: INFO nova.compute.manager [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Terminating instance
Apr 11 22:09:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26432626634663165', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432626634663165', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG nova.objects.instance [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'flavor' on Instance uuid d6f50e18-5362-4910-9749-4b8122720a2f {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 22:09:37 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:09:37 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:09:37 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:09:37 user nova-compute[71364]:   <serial>5488a5c7-704c-436f-a4f9-5b27d029067a</serial>
Apr 11 22:09:37 user nova-compute[71364]: </disk>
Apr 11 22:09:37 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-f8730fa3-db92-4e36-9b46-297a42c019cb req-14eeaef7-253f-45fb-8b51-ca0c792d7d32 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-vif-unplugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8730fa3-db92-4e36-9b46-297a42c019cb req-14eeaef7-253f-45fb-8b51-ca0c792d7d32 service nova] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8730fa3-db92-4e36-9b46-297a42c019cb req-14eeaef7-253f-45fb-8b51-ca0c792d7d32 service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f8730fa3-db92-4e36-9b46-297a42c019cb req-14eeaef7-253f-45fb-8b51-ca0c792d7d32 service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-f8730fa3-db92-4e36-9b46-297a42c019cb req-14eeaef7-253f-45fb-8b51-ca0c792d7d32 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] No waiting events found dispatching network-vif-unplugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-f8730fa3-db92-4e36-9b46-297a42c019cb req-14eeaef7-253f-45fb-8b51-ca0c792d7d32 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-vif-unplugged-3b90af5a-ae8d-4876-bda9-002751948bb0 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] No VIF found with MAC fa:16:3e:2a:7a:7b, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.343s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:38 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Instance destroyed successfully.
Apr 11 22:09:38 user nova-compute[71364]: DEBUG nova.objects.instance [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'resources' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:03:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1950121008',display_name='tempest-ServerRescueNegativeTestJSON-server-1950121008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1950121008',id=29,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1rI3/ko2FizEbaKBgYZ6vNc2Qja+cKtbUN+7VeXaafSg+Iq4uwb7LY1gcxR2uaqZyccMuV4smpseEyWhf4dx7LAxvozpzLvmsuld7AJptCsX+pJs1Gi+3Tk2oYbYYwHA==',key_name='tempest-keypair-337352633',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:05:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c35707743988462887127e06825cd483',ramdisk_id='',reservation_id='r-9ala1i8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-797099247',owner_user_name='tempest-ServerRescueNegativeTestJSON-797099247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:07:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='546f0a94a2ad450ead596252c786839e',uuid=b485c9c2-8fb4-4690-af26-ddfae00d5024,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converting VIF {"id": "3b90af5a-ae8d-4876-bda9-002751948bb0", "address": "fa:16:3e:38:4c:82", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b90af5a-ae", "ovs_interfaceid": "3b90af5a-ae8d-4876-bda9-002751948bb0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:4c:82,bridge_name='br-int',has_traffic_filtering=True,id=3b90af5a-ae8d-4876-bda9-002751948bb0,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b90af5a-ae') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG os_vif [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:4c:82,bridge_name='br-int',has_traffic_filtering=True,id=3b90af5a-ae8d-4876-bda9-002751948bb0,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b90af5a-ae') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b90af5a-ae, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:38 user nova-compute[71364]: INFO os_vif [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:4c:82,bridge_name='br-int',has_traffic_filtering=True,id=3b90af5a-ae8d-4876-bda9-002751948bb0,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b90af5a-ae')
Apr 11 22:09:38 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Deleting instance files /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024_del
Apr 11 22:09:38 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Deletion of /opt/stack/data/nova/instances/b485c9c2-8fb4-4690-af26-ddfae00d5024_del complete
Apr 11 22:09:38 user nova-compute[71364]: INFO nova.compute.manager [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Took 1.05 seconds to destroy the instance on the hypervisor.
Apr 11 22:09:38 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:09:38 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:09:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:39 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:09:39 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Took 0.89 seconds to deallocate network for instance.
Apr 11 22:09:39 user nova-compute[71364]: DEBUG nova.compute.manager [req-3f4d0f43-2d52-490f-a086-4062d7ce0a52 req-3240a367-fa7d-4bd2-ba58-2424d7e44a74 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-vif-deleted-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:09:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:39 user nova-compute[71364]: DEBUG nova.compute.manager [req-6bdba955-c904-45a4-bf84-f9d007258bec req-8c76e434-b83c-4a96-88aa-71afa1a4c536 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:09:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6bdba955-c904-45a4-bf84-f9d007258bec req-8c76e434-b83c-4a96-88aa-71afa1a4c536 service nova] Acquiring lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6bdba955-c904-45a4-bf84-f9d007258bec req-8c76e434-b83c-4a96-88aa-71afa1a4c536 service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6bdba955-c904-45a4-bf84-f9d007258bec req-8c76e434-b83c-4a96-88aa-71afa1a4c536 service nova] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:39 user nova-compute[71364]: DEBUG nova.compute.manager [req-6bdba955-c904-45a4-bf84-f9d007258bec req-8c76e434-b83c-4a96-88aa-71afa1a4c536 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] No waiting events found dispatching network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:09:39 user nova-compute[71364]: WARNING nova.compute.manager [req-6bdba955-c904-45a4-bf84-f9d007258bec req-8c76e434-b83c-4a96-88aa-71afa1a4c536 service nova] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Received unexpected event network-vif-plugged-3b90af5a-ae8d-4876-bda9-002751948bb0 for instance with vm_state deleted and task_state None.
Apr 11 22:09:40 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:40 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Deleted allocations for instance b485c9c2-8fb4-4690-af26-ddfae00d5024
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b485c9c2-8fb4-4690-af26-ddfae00d5024" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.684s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "d6f50e18-5362-4910-9749-4b8122720a2f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG nova.objects.instance [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'flavor' on Instance uuid d6f50e18-5362-4910-9749-4b8122720a2f {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "d6f50e18-5362-4910-9749-4b8122720a2f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:40 user nova-compute[71364]: INFO nova.compute.manager [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Attaching volume 19933b87-7547-4f3d-bc50-b7345b42ca78 to /dev/vdc
Apr 11 22:09:40 user nova-compute[71364]: DEBUG os_brick.utils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[241f3b36-ab7d-4285-b800-82fb4f479c62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[58741880-deb9-4924-8af6-42e80d02b706]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[02483d59-9dc6-4b46-814d-20ea0626460b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[163dc7c2-aba3-482b-98a5-97f2baf6af80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:09:40 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[022a564d-d4a9-4b17-a44f-9f1392bdc381]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG os_brick.utils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Updating existing volume attachment record: dd1e9870-fb2d-4ddf-b361-e75e078a7bf7 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "c564e327-b508-4b88-a393-e30a166ac848" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "c564e327-b508-4b88-a393-e30a166ac848" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "c564e327-b508-4b88-a393-e30a166ac848-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "c564e327-b508-4b88-a393-e30a166ac848-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "c564e327-b508-4b88-a393-e30a166ac848-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:40 user nova-compute[71364]: INFO nova.compute.manager [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Terminating instance
Apr 11 22:09:40 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:41 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: c564e327-b508-4b88-a393-e30a166ac848] Instance destroyed successfully.
Apr 11 22:09:41 user nova-compute[71364]: DEBUG nova.objects.instance [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'resources' on Instance uuid c564e327-b508-4b88-a393-e30a166ac848 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-303719685',display_name='tempest-AttachVolumeNegativeTest-server-303719685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-303719685',id=34,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYj0hQ2mfvO6PnRQDsRwvFRKSTCH4FHgJv4ERFWLkIIYi1p1NYH+rIsvWwsFXfCZJbajB3xQDgUUVssjT2WCxobuMqhpq9I2t6v+G1412BqLx+cDG4G0enxUnO2r0pY/g==',key_name='tempest-keypair-268153557',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:06:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='722a2704f607415ebe42af5ad98bf419',ramdisk_id='',reservation_id='r-jyc18oia',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2131251711',owner_user_name='tempest-AttachVolumeNegativeTest-2131251711-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:06:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6d615e85afb4354b37e88b5a24429d8',uuid=c564e327-b508-4b88-a393-e30a166ac848,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "379495b1-9aee-4d67-8b10-517792434e1b", "address": "fa:16:3e:aa:2c:cf", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap379495b1-9a", "ovs_interfaceid": "379495b1-9aee-4d67-8b10-517792434e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converting VIF {"id": "379495b1-9aee-4d67-8b10-517792434e1b", "address": "fa:16:3e:aa:2c:cf", "network": {"id": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1168328126-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "722a2704f607415ebe42af5ad98bf419", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap379495b1-9a", "ovs_interfaceid": "379495b1-9aee-4d67-8b10-517792434e1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:2c:cf,bridge_name='br-int',has_traffic_filtering=True,id=379495b1-9aee-4d67-8b10-517792434e1b,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap379495b1-9a') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG os_vif [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:2c:cf,bridge_name='br-int',has_traffic_filtering=True,id=379495b1-9aee-4d67-8b10-517792434e1b,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap379495b1-9a') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap379495b1-9a, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:41 user nova-compute[71364]: INFO os_vif [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:2c:cf,bridge_name='br-int',has_traffic_filtering=True,id=379495b1-9aee-4d67-8b10-517792434e1b,network=Network(39cbda6a-fc42-49a7-b05b-8f5c0af7c368),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap379495b1-9a')
Apr 11 22:09:41 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Deleting instance files /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848_del
Apr 11 22:09:41 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Deletion of /opt/stack/data/nova/instances/c564e327-b508-4b88-a393-e30a166ac848_del complete
Apr 11 22:09:41 user nova-compute[71364]: INFO nova.compute.manager [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 11 22:09:41 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: c564e327-b508-4b88-a393-e30a166ac848] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: c564e327-b508-4b88-a393-e30a166ac848] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Received event network-vif-unplugged-379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] Acquiring lock "c564e327-b508-4b88-a393-e30a166ac848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] Lock "c564e327-b508-4b88-a393-e30a166ac848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] Lock "c564e327-b508-4b88-a393-e30a166ac848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] No waiting events found dispatching network-vif-unplugged-379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Received event network-vif-unplugged-379495b1-9aee-4d67-8b10-517792434e1b for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Received event network-vif-plugged-379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] Acquiring lock "c564e327-b508-4b88-a393-e30a166ac848-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] Lock "c564e327-b508-4b88-a393-e30a166ac848-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] Lock "c564e327-b508-4b88-a393-e30a166ac848-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] No waiting events found dispatching network-vif-plugged-379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:09:41 user nova-compute[71364]: WARNING nova.compute.manager [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Received unexpected event network-vif-plugged-379495b1-9aee-4d67-8b10-517792434e1b for instance with vm_state active and task_state deleting.
Apr 11 22:09:42 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: c564e327-b508-4b88-a393-e30a166ac848] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:09:42 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: c564e327-b508-4b88-a393-e30a166ac848] Took 0.88 seconds to deallocate network for instance.
Apr 11 22:09:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-048af61c-e30b-41f2-942c-46bc08863e21 req-f84d6361-cd36-481f-a02f-25c5dd493346 service nova] [instance: c564e327-b508-4b88-a393-e30a166ac848] Received event network-vif-deleted-379495b1-9aee-4d67-8b10-517792434e1b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:09:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:43 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:09:43 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:09:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:43 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Deleted allocations for instance c564e327-b508-4b88-a393-e30a166ac848
Apr 11 22:09:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "c564e327-b508-4b88-a393-e30a166ac848" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.266s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kcvXmrQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:09:45 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:09:45 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:09:45 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf02db7-6995-4001-bc66-e10904d3fcac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:09:45 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beb9710-2a3c-458f-801a-c20c0f91a10b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78] added
Apr 11 22:09:45 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c8e660-9cf1-4294-8867-e83fe5cbab2c]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f30593-9d42-4204-b22e-1fa4d05ba797]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kcvXmrQx {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kcvXmrQx" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3081af55-8878-4b51-b8b3-7c8607a5761b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kcvXmrQx'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[861cd9f2-7cf6-4c62-b9b2-76f9ffa71b06]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad61cc5-c4ab-4b48-af6d-5766d5c5b1d4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:09:45 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:09:45 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:09:45 user nova-compute[71364]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a (non-flash)
Apr 11 22:09:45 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:09:45 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:09:45 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:09:45 user nova-compute[71364]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a (non-flash)
Apr 11 22:09:45 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cea1f20-c0d1-4d50-b399-3d2005eff73f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78, portal: 172.16.0.220,3260]
Apr 11 22:09:45 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78, portal: 172.16.0.220,3260] successful.
Apr 11 22:09:45 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[97729fa8-6353-481a-b11a-fbfefab9ea84]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9f98c6-b3f0-4c9f-97a2-899076d5b1d5]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:09:45 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:09:45 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:09:45 user nova-compute[71364]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a (non-flash)
Apr 11 22:09:45 user nova-compute[71364]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 (non-flash)
Apr 11 22:09:45 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:09:45 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:09:45 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:09:45 user nova-compute[71364]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a (non-flash)
Apr 11 22:09:45 user nova-compute[71364]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 (non-flash)
Apr 11 22:09:45 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b270b936-d1f6-4916-808b-d08afea367a7]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:09:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kcvXmrQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:09:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:09:46 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23135366138346436', 'path': '/dev/sdf'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:09:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135366138346436', 'path': '/dev/sdf'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:09:46 user nova-compute[71364]: DEBUG nova.objects.instance [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'flavor' on Instance uuid d6f50e18-5362-4910-9749-4b8122720a2f {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:09:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 22:09:46 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:09:46 user nova-compute[71364]:   <source dev="/dev/sdf"/>
Apr 11 22:09:46 user nova-compute[71364]:   <target dev="vdc" bus="virtio"/>
Apr 11 22:09:46 user nova-compute[71364]:   <serial>19933b87-7547-4f3d-bc50-b7345b42ca78</serial>
Apr 11 22:09:46 user nova-compute[71364]: </disk>
Apr 11 22:09:46 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 22:09:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:09:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:09:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:09:46 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] No VIF found with MAC fa:16:3e:2a:7a:7b, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:09:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.294s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "d6f50e18-5362-4910-9749-4b8122720a2f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:47 user nova-compute[71364]: INFO nova.compute.manager [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Detaching volume 5488a5c7-704c-436f-a4f9-5b27d029067a
Apr 11 22:09:47 user nova-compute[71364]: INFO nova.virt.block_device [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Attempting to driver detach volume 5488a5c7-704c-436f-a4f9-5b27d029067a from mountpoint /dev/vdb
Apr 11 22:09:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Attempting to detach device vdb from instance d6f50e18-5362-4910-9749-4b8122720a2f from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:09:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:09:47 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:09:47 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:09:47 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:09:47 user nova-compute[71364]:   <serial>5488a5c7-704c-436f-a4f9-5b27d029067a</serial>
Apr 11 22:09:47 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:09:47 user nova-compute[71364]: </disk>
Apr 11 22:09:47 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:09:47 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Successfully detached device vdb from instance d6f50e18-5362-4910-9749-4b8122720a2f from the persistent domain config.
Apr 11 22:09:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6f50e18-5362-4910-9749-4b8122720a2f from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:09:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:09:47 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:09:47 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:09:47 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:09:47 user nova-compute[71364]:   <serial>5488a5c7-704c-436f-a4f9-5b27d029067a</serial>
Apr 11 22:09:47 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:09:47 user nova-compute[71364]: </disk>
Apr 11 22:09:47 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:09:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681250987.9781218, d6f50e18-5362-4910-9749-4b8122720a2f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:09:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6f50e18-5362-4910-9749-4b8122720a2f {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:09:47 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Successfully detached device vdb from instance d6f50e18-5362-4910-9749-4b8122720a2f from the live domain config.
Apr 11 22:09:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:09:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAFHgqer', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:09:47 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:09:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:09:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:09:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39bcf3b-9c98-4c01-8e1a-ca99be7d3ddd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:09:48 user nova-compute[71364]: No targets found.
Apr 11 22:09:48 user nova-compute[71364]: iSNS:
Apr 11 22:09:48 user nova-compute[71364]: No targets found.
Apr 11 22:09:48 user nova-compute[71364]: STATIC:
Apr 11 22:09:48 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:09:48 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:09:48 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:09:48 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba
Apr 11 22:09:48 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:09:48 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:09:48 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78
Apr 11 22:09:48 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:09:48 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:09:48 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a
Apr 11 22:09:48 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:09:48 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:09:48 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c
Apr 11 22:09:48 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:09:48 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:09:48 user nova-compute[71364]: FIRMWARE:
Apr 11 22:09:48 user nova-compute[71364]: No targets found.
Apr 11 22:09:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:09:48 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:09:48 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[850f3d24-e763-4315-83cf-8b03164132c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[027816bd-87b0-4aa1-9985-18f56905128c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:09:48 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:09:48 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:09:48 user nova-compute[71364]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a (non-flash)
Apr 11 22:09:48 user nova-compute[71364]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 (non-flash)
Apr 11 22:09:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:09:48 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:09:48 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:09:48 user nova-compute[71364]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a (non-flash)
Apr 11 22:09:48 user nova-compute[71364]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 (non-flash)
Apr 11 22:09:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff7567a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe75caea-124a-4fdd-8f26-593a78774e17]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bfe137-b4e7-4e21-b7c9-fe7fc03cdf44]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d385ac4-ad29-498d-9e32-b17283ff9c2b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2881ba6-1207-4d79-ad0b-ff8b21433a2d]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8f881d-67a7-4a97-8b27-3285797037da]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3bc9df-6072-48b8-b406-f2fa06867d99]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a, portal: 172.16.0.220,3260]
Apr 11 22:09:48 user nova-compute[71364]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a, portal: 172.16.0.220,3260] successful.
Apr 11 22:09:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5488a5c7-704c-436f-a4f9-5b27d029067a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5451966-ab47-4232-9011-63da2745c9ed]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] <== disconnect_volume: return (323ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:09:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:09:49 user nova-compute[71364]: DEBUG nova.objects.instance [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'flavor' on Instance uuid d6f50e18-5362-4910-9749-4b8122720a2f {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:09:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.670s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "d6f50e18-5362-4910-9749-4b8122720a2f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:49 user nova-compute[71364]: INFO nova.compute.manager [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Detaching volume 19933b87-7547-4f3d-bc50-b7345b42ca78
Apr 11 22:09:49 user nova-compute[71364]: INFO nova.virt.block_device [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Attempting to driver detach volume 19933b87-7547-4f3d-bc50-b7345b42ca78 from mountpoint /dev/vdc
Apr 11 22:09:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Attempting to detach device vdc from instance d6f50e18-5362-4910-9749-4b8122720a2f from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:09:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:09:49 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:09:49 user nova-compute[71364]:   <source dev="/dev/sdf"/>
Apr 11 22:09:49 user nova-compute[71364]:   <target dev="vdc" bus="virtio"/>
Apr 11 22:09:49 user nova-compute[71364]:   <serial>19933b87-7547-4f3d-bc50-b7345b42ca78</serial>
Apr 11 22:09:49 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 22:09:49 user nova-compute[71364]: </disk>
Apr 11 22:09:49 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:09:50 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Successfully detached device vdc from instance d6f50e18-5362-4910-9749-4b8122720a2f from the persistent domain config.
Apr 11 22:09:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d6f50e18-5362-4910-9749-4b8122720a2f from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:09:50 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:09:50 user nova-compute[71364]:   <source dev="/dev/sdf"/>
Apr 11 22:09:50 user nova-compute[71364]:   <target dev="vdc" bus="virtio"/>
Apr 11 22:09:50 user nova-compute[71364]:   <serial>19933b87-7547-4f3d-bc50-b7345b42ca78</serial>
Apr 11 22:09:50 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 11 22:09:50 user nova-compute[71364]: </disk>
Apr 11 22:09:50 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681250990.3801544, d6f50e18-5362-4910-9749-4b8122720a2f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d6f50e18-5362-4910-9749-4b8122720a2f {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:09:50 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Successfully detached device vdc from instance d6f50e18-5362-4910-9749-4b8122720a2f from the live domain config.
Apr 11 22:09:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kcvXmrQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:09:50 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85ffd5b-74b4-41e8-b36b-a00410e5469f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:09:50 user nova-compute[71364]: No targets found.
Apr 11 22:09:50 user nova-compute[71364]: iSNS:
Apr 11 22:09:50 user nova-compute[71364]: No targets found.
Apr 11 22:09:50 user nova-compute[71364]: STATIC:
Apr 11 22:09:50 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:09:50 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:09:50 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:09:50 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba
Apr 11 22:09:50 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:09:50 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:09:50 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78
Apr 11 22:09:50 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:09:50 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:09:50 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c
Apr 11 22:09:50 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:09:50 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:09:50 user nova-compute[71364]: FIRMWARE:
Apr 11 22:09:50 user nova-compute[71364]: No targets found.
Apr 11 22:09:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:09:50 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:09:50 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a1425d-e930-47af-899d-a34eb52bc555]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6109909c-6e94-4d51-a07a-781890c6efc8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:09:50 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:09:50 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:09:50 user nova-compute[71364]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 (non-flash)
Apr 11 22:09:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:09:50 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:09:50 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:09:50 user nova-compute[71364]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 (non-flash)
Apr 11 22:09:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bf02970a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78'): ({'sdf'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Removing single pathed devices sdf {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[815b1c8a-04a9-4a32-81df-db9906944988]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb82473-138d-4d6e-978d-21310063870f]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flushing IO for device /dev/sdf {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2346099-5567-455a-804f-2ddafae90760]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6217f289-04f7-419d-92ec-912b59a17601]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] SCSI volumes sdf have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f099f39-c782-40b0-bcfa-c096f5e7e3dc]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c74cde-de26-41f5-b002-bdc807d17c71]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78, portal: 172.16.0.220,3260]
Apr 11 22:09:50 user nova-compute[71364]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78, portal: 172.16.0.220,3260] successful.
Apr 11 22:09:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19933b87-7547-4f3d-bc50-b7345b42ca78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83bce5c-84f7-49b9-97f5-f7e1b2d749c9]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] <== disconnect_volume: return (294ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:09:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:09:51 user nova-compute[71364]: DEBUG nova.objects.instance [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'flavor' on Instance uuid d6f50e18-5362-4910-9749-4b8122720a2f {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:09:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.543s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "d6f50e18-5362-4910-9749-4b8122720a2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:52 user nova-compute[71364]: INFO nova.compute.manager [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Terminating instance
Apr 11 22:09:52 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-515e7b14-0b97-46df-ae8c-e72ba556d80e req-8f657427-7508-420d-abd7-6405d3bceff5 service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Received event network-vif-unplugged-189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-515e7b14-0b97-46df-ae8c-e72ba556d80e req-8f657427-7508-420d-abd7-6405d3bceff5 service nova] Acquiring lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-515e7b14-0b97-46df-ae8c-e72ba556d80e req-8f657427-7508-420d-abd7-6405d3bceff5 service nova] Lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-515e7b14-0b97-46df-ae8c-e72ba556d80e req-8f657427-7508-420d-abd7-6405d3bceff5 service nova] Lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-515e7b14-0b97-46df-ae8c-e72ba556d80e req-8f657427-7508-420d-abd7-6405d3bceff5 service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] No waiting events found dispatching network-vif-unplugged-189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:09:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-515e7b14-0b97-46df-ae8c-e72ba556d80e req-8f657427-7508-420d-abd7-6405d3bceff5 service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Received event network-vif-unplugged-189a45d4-e65d-4466-9de5-61f14a667d7e for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:09:53 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Instance destroyed successfully.
Apr 11 22:09:53 user nova-compute[71364]: DEBUG nova.objects.instance [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'resources' on Instance uuid d6f50e18-5362-4910-9749-4b8122720a2f {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:09:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:07:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-46710285',display_name='tempest-AttachVolumeTestJSON-server-46710285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-46710285',id=35,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjlELRYqzP7CZz3vqsGQyXpY1mcBXFG5DfukejDbcUqsBk3HCNAb9YE2xJsI/wlGPb6TsDx/yhWhzBSTHbmOEw9jTJunYPpRtn5VbZn6Reg1dl6Jw9odvmHPl4S7+7Naw==',key_name='tempest-keypair-1050830117',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:07:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5aa35cf81ae74532a074bde65f192848',ramdisk_id='',reservation_id='r-blumh0qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1865595781',owner_user_name='tempest-AttachVolumeTestJSON-1865595781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:07:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76211a47ed9b4a8abdeeea98c774d3d7',uuid=d6f50e18-5362-4910-9749-4b8122720a2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "189a45d4-e65d-4466-9de5-61f14a667d7e", "address": "fa:16:3e:2a:7a:7b", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a45d4-e6", "ovs_interfaceid": "189a45d4-e65d-4466-9de5-61f14a667d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:09:53 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converting VIF {"id": "189a45d4-e65d-4466-9de5-61f14a667d7e", "address": "fa:16:3e:2a:7a:7b", "network": {"id": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1743671668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5aa35cf81ae74532a074bde65f192848", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap189a45d4-e6", "ovs_interfaceid": "189a45d4-e65d-4466-9de5-61f14a667d7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:09:53 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:7a:7b,bridge_name='br-int',has_traffic_filtering=True,id=189a45d4-e65d-4466-9de5-61f14a667d7e,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189a45d4-e6') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:09:53 user nova-compute[71364]: DEBUG os_vif [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:7a:7b,bridge_name='br-int',has_traffic_filtering=True,id=189a45d4-e65d-4466-9de5-61f14a667d7e,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189a45d4-e6') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:09:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap189a45d4-e6, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:09:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:09:53 user nova-compute[71364]: INFO os_vif [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:7a:7b,bridge_name='br-int',has_traffic_filtering=True,id=189a45d4-e65d-4466-9de5-61f14a667d7e,network=Network(eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap189a45d4-e6')
Apr 11 22:09:53 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Deleting instance files /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f_del
Apr 11 22:09:53 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Deletion of /opt/stack/data/nova/instances/d6f50e18-5362-4910-9749-4b8122720a2f_del complete
Apr 11 22:09:53 user nova-compute[71364]: INFO nova.compute.manager [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 11 22:09:53 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:09:53 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:09:53 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:09:53 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250978.499384, b485c9c2-8fb4-4690-af26-ddfae00d5024 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:09:53 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] VM Stopped (Lifecycle Event)
Apr 11 22:09:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-addd5536-2e15-4179-ba71-bb76b1f7d901 None None] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:09:53 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:09:54 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Took 0.66 seconds to deallocate network for instance.
Apr 11 22:09:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-3cc5f193-b5f2-44ef-b169-ebba8b99e5cb req-01fb7125-6c27-43ad-b925-0a922fe5bc2c service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Received event network-vif-deleted-189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:09:54 user nova-compute[71364]: INFO nova.compute.manager [req-3cc5f193-b5f2-44ef-b169-ebba8b99e5cb req-01fb7125-6c27-43ad-b925-0a922fe5bc2c service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Neutron deleted interface 189a45d4-e65d-4466-9de5-61f14a667d7e; detaching it from the instance and deleting it from the info cache
Apr 11 22:09:54 user nova-compute[71364]: DEBUG nova.network.neutron [req-3cc5f193-b5f2-44ef-b169-ebba8b99e5cb req-01fb7125-6c27-43ad-b925-0a922fe5bc2c service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:09:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-3cc5f193-b5f2-44ef-b169-ebba8b99e5cb req-01fb7125-6c27-43ad-b925-0a922fe5bc2c service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Detach interface failed, port_id=189a45d4-e65d-4466-9de5-61f14a667d7e, reason: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 22:09:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:54 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:09:54 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:09:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:54 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Deleted allocations for instance d6f50e18-5362-4910-9749-4b8122720a2f
Apr 11 22:09:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "d6f50e18-5362-4910-9749-4b8122720a2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.997s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-7d35c773-f705-4375-a526-8c171d880bf9 req-6416f2b8-acda-4a9d-aeeb-4788b321b4cd service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Received event network-vif-plugged-189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:09:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7d35c773-f705-4375-a526-8c171d880bf9 req-6416f2b8-acda-4a9d-aeeb-4788b321b4cd service nova] Acquiring lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7d35c773-f705-4375-a526-8c171d880bf9 req-6416f2b8-acda-4a9d-aeeb-4788b321b4cd service nova] Lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7d35c773-f705-4375-a526-8c171d880bf9 req-6416f2b8-acda-4a9d-aeeb-4788b321b4cd service nova] Lock "d6f50e18-5362-4910-9749-4b8122720a2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:09:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-7d35c773-f705-4375-a526-8c171d880bf9 req-6416f2b8-acda-4a9d-aeeb-4788b321b4cd service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] No waiting events found dispatching network-vif-plugged-189a45d4-e65d-4466-9de5-61f14a667d7e {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:09:54 user nova-compute[71364]: WARNING nova.compute.manager [req-7d35c773-f705-4375-a526-8c171d880bf9 req-6416f2b8-acda-4a9d-aeeb-4788b321b4cd service nova] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Received unexpected event network-vif-plugged-189a45d4-e65d-4466-9de5-61f14a667d7e for instance with vm_state deleted and task_state None.
Apr 11 22:09:56 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250981.6718013, c564e327-b508-4b88-a393-e30a166ac848 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:09:56 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: c564e327-b508-4b88-a393-e30a166ac848] VM Stopped (Lifecycle Event)
Apr 11 22:09:56 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e6c2b45d-0f17-4f6a-b9db-7b012ed2938f None None] [instance: c564e327-b508-4b88-a393-e30a166ac848] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:09:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:09:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:09:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:09:59 user nova-compute[71364]: DEBUG nova.compute.manager [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Going to confirm migration 2 {{(pid=71364) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 11 22:10:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:10:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquired lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:10:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:10:00 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'info_cache' on Instance uuid ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:10:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Updating instance_info_cache with network_info: [{"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:10:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Releasing lock "refresh_cache-ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:10:00 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'migration_context' on Instance uuid ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:10:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:10:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:10:00 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:10:00 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:10:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.319s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:10:01 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:10:01 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Deleted allocation for migration 2e306164-a391-4e86-ad79-9ec93af8a716
Apr 11 22:10:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.230s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:05 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:10:05 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:10:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8045MB free_disk=26.07022476196289GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d6268190-2187-4596-9f0b-026c520e5c67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:10:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:10:08 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681250993.2473836, d6f50e18-5362-4910-9749-4b8122720a2f => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:10:08 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] VM Stopped (Lifecycle Event)
Apr 11 22:10:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-481e14c1-2d0e-492b-b79d-fd9126a00b24 None None] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:10:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:10:08 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:10:08 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:10:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:10:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:10:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:10:08 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:10:09 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Updating instance_info_cache with network_info: [{"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:10:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-b66951a9-73f3-41ce-9f19-b4e5e24d61b0" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:10:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:10:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:10:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:10:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:10:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:10:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:10:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:10:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:10:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:10:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:10:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:10:32 user nova-compute[71364]: INFO nova.compute.manager [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Terminating instance
Apr 11 22:10:32 user nova-compute[71364]: DEBUG nova.compute.manager [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-7f3115ba-f964-4d78-8b75-6a95d7111d06 req-7023c3bd-01a7-4bdf-b013-61255a7ec858 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received event network-vif-unplugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7f3115ba-f964-4d78-8b75-6a95d7111d06 req-7023c3bd-01a7-4bdf-b013-61255a7ec858 service nova] Acquiring lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7f3115ba-f964-4d78-8b75-6a95d7111d06 req-7023c3bd-01a7-4bdf-b013-61255a7ec858 service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7f3115ba-f964-4d78-8b75-6a95d7111d06 req-7023c3bd-01a7-4bdf-b013-61255a7ec858 service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-7f3115ba-f964-4d78-8b75-6a95d7111d06 req-7023c3bd-01a7-4bdf-b013-61255a7ec858 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] No waiting events found dispatching network-vif-unplugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-7f3115ba-f964-4d78-8b75-6a95d7111d06 req-7023c3bd-01a7-4bdf-b013-61255a7ec858 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received event network-vif-unplugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:32 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Instance destroyed successfully.
Apr 11 22:10:32 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'resources' on Instance uuid 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1993933386',display_name='tempest-ServerRescueNegativeTestJSON-server-1993933386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1993933386',id=18,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:56:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c35707743988462887127e06825cd483',ramdisk_id='',reservation_id='r-05vqbj4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-797099247',owner_user_name='tempest-ServerRescueNegativeTestJSON-797099247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:56:33Z,user_data=None,user_id='546f0a94a2ad450ead596252c786839e',uuid=76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converting VIF {"id": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "address": "fa:16:3e:d3:96:ef", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ff224c-ce", "ovs_interfaceid": "03ff224c-ce46-4e9a-8eae-357d41acfef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=03ff224c-ce46-4e9a-8eae-357d41acfef2,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ff224c-ce') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG os_vif [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=03ff224c-ce46-4e9a-8eae-357d41acfef2,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ff224c-ce') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03ff224c-ce, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:32 user nova-compute[71364]: INFO os_vif [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:96:ef,bridge_name='br-int',has_traffic_filtering=True,id=03ff224c-ce46-4e9a-8eae-357d41acfef2,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ff224c-ce')
Apr 11 22:10:32 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Deleting instance files /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d_del
Apr 11 22:10:32 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Deletion of /opt/stack/data/nova/instances/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d_del complete
Apr 11 22:10:32 user nova-compute[71364]: INFO nova.compute.manager [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Took 0.69 seconds to destroy the instance on the hypervisor.
Apr 11 22:10:32 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:10:32 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:10:33 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:10:33 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Took 0.60 seconds to deallocate network for instance.
Apr 11 22:10:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-c9130416-98fa-4acc-9535-f023e4affab2 req-9ceda92b-3246-460d-a79e-859347e924ef service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received event network-vif-deleted-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:10:33 user nova-compute[71364]: INFO nova.compute.manager [req-c9130416-98fa-4acc-9535-f023e4affab2 req-9ceda92b-3246-460d-a79e-859347e924ef service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Neutron deleted interface 03ff224c-ce46-4e9a-8eae-357d41acfef2; detaching it from the instance and deleting it from the info cache
Apr 11 22:10:33 user nova-compute[71364]: DEBUG nova.network.neutron [req-c9130416-98fa-4acc-9535-f023e4affab2 req-9ceda92b-3246-460d-a79e-859347e924ef service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:10:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-c9130416-98fa-4acc-9535-f023e4affab2 req-9ceda92b-3246-460d-a79e-859347e924ef service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Detach interface failed, port_id=03ff224c-ce46-4e9a-8eae-357d41acfef2, reason: Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 22:10:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:10:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:10:33 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:10:33 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:10:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:10:33 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Deleted allocations for instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d
Apr 11 22:10:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.737s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:10:34 user nova-compute[71364]: DEBUG nova.compute.manager [req-f55d1c80-9988-4a57-80e4-821ba27f1268 req-32eb5a57-3939-4a98-a302-a253c0e00886 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received event network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:10:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f55d1c80-9988-4a57-80e4-821ba27f1268 req-32eb5a57-3939-4a98-a302-a253c0e00886 service nova] Acquiring lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:10:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f55d1c80-9988-4a57-80e4-821ba27f1268 req-32eb5a57-3939-4a98-a302-a253c0e00886 service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:10:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f55d1c80-9988-4a57-80e4-821ba27f1268 req-32eb5a57-3939-4a98-a302-a253c0e00886 service nova] Lock "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:10:34 user nova-compute[71364]: DEBUG nova.compute.manager [req-f55d1c80-9988-4a57-80e4-821ba27f1268 req-32eb5a57-3939-4a98-a302-a253c0e00886 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] No waiting events found dispatching network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:10:34 user nova-compute[71364]: WARNING nova.compute.manager [req-f55d1c80-9988-4a57-80e4-821ba27f1268 req-32eb5a57-3939-4a98-a302-a253c0e00886 service nova] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Received unexpected event network-vif-plugged-03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance with vm_state deleted and task_state None.
Apr 11 22:10:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:47 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251032.8226192, 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:10:47 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] VM Stopped (Lifecycle Event)
Apr 11 22:10:47 user nova-compute[71364]: DEBUG nova.compute.manager [None req-70544d62-0bb0-4997-acf4-1efd7b28dbff None None] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:10:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:10:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:10:56 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:10:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:10:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:10:56 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:10:56 user nova-compute[71364]: INFO nova.compute.claims [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Claim successful on node user
Apr 11 22:10:57 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG nova.network.neutron [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:10:57 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:10:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG nova.policy [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd28c7ae9f6dc4f06a7202bcab3afb0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2e33082edb407983882075d3237264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:10:57 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Creating image(s)
Apr 11 22:10:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "/opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "/opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.147s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk 1073741824" returned: 0 in 0.054s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:10:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Successfully created port: 6c0af63c-303d-44dd-acb5-0b939a80a8f3 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.156s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Cannot resize image /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG nova.objects.instance [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lazy-loading 'migration_context' on Instance uuid 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Ensure instance console log exists: /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Successfully updated port: 6c0af63c-303d-44dd-acb5-0b939a80a8f3 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "refresh_cache-8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquired lock "refresh_cache-8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG nova.compute.manager [req-e6f8db04-7741-439b-bbd0-e7264cdff103 req-3f7df433-529b-4f20-9a6b-e2974e9cdb10 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Received event network-changed-6c0af63c-303d-44dd-acb5-0b939a80a8f3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG nova.compute.manager [req-e6f8db04-7741-439b-bbd0-e7264cdff103 req-3f7df433-529b-4f20-9a6b-e2974e9cdb10 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Refreshing instance network info cache due to event network-changed-6c0af63c-303d-44dd-acb5-0b939a80a8f3. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:10:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e6f8db04-7741-439b-bbd0-e7264cdff103 req-3f7df433-529b-4f20-9a6b-e2974e9cdb10 service nova] Acquiring lock "refresh_cache-8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.network.neutron [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Updating instance_info_cache with network_info: [{"id": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "address": "fa:16:3e:f6:18:9c", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0af63c-30", "ovs_interfaceid": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Releasing lock "refresh_cache-8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Instance network_info: |[{"id": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "address": "fa:16:3e:f6:18:9c", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0af63c-30", "ovs_interfaceid": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e6f8db04-7741-439b-bbd0-e7264cdff103 req-3f7df433-529b-4f20-9a6b-e2974e9cdb10 service nova] Acquired lock "refresh_cache-8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.network.neutron [req-e6f8db04-7741-439b-bbd0-e7264cdff103 req-3f7df433-529b-4f20-9a6b-e2974e9cdb10 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Refreshing network info cache for port 6c0af63c-303d-44dd-acb5-0b939a80a8f3 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Start _get_guest_xml network_info=[{"id": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "address": "fa:16:3e:f6:18:9c", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0af63c-30", "ovs_interfaceid": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:10:59 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:10:59 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-845148370',display_name='tempest-VolumesSnapshotTestJSON-instance-845148370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-845148370',id=36,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b2e33082edb407983882075d3237264',ramdisk_id='',reservation_id='r-tmryv04l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-279092346',owner_user_name='tempest-VolumesSnapshotTestJSON-279092346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:10:57Z,user_data=None,user_id='d28c7ae9f6dc4f06a7202bcab3afb0ac',uuid=8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "address": "fa:16:3e:f6:18:9c", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0af63c-30", "ovs_interfaceid": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Converting VIF {"id": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "address": "fa:16:3e:f6:18:9c", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0af63c-30", "ovs_interfaceid": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=6c0af63c-303d-44dd-acb5-0b939a80a8f3,network=Network(65f8b365-752d-40d7-aa38-7980a188a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c0af63c-30') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.objects.instance [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:10:59 user nova-compute[71364]:   <uuid>8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef</uuid>
Apr 11 22:10:59 user nova-compute[71364]:   <name>instance-00000024</name>
Apr 11 22:10:59 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:10:59 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:10:59 user nova-compute[71364]:   <metadata>
Apr 11 22:10:59 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:10:59 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:10:59 user nova-compute[71364]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-845148370</nova:name>
Apr 11 22:10:59 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:10:59</nova:creationTime>
Apr 11 22:10:59 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:10:59 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:10:59 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:10:59 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:10:59 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:10:59 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:10:59 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:10:59 user nova-compute[71364]:       <nova:owner>
Apr 11 22:10:59 user nova-compute[71364]:         <nova:user uuid="d28c7ae9f6dc4f06a7202bcab3afb0ac">tempest-VolumesSnapshotTestJSON-279092346-project-member</nova:user>
Apr 11 22:10:59 user nova-compute[71364]:         <nova:project uuid="4b2e33082edb407983882075d3237264">tempest-VolumesSnapshotTestJSON-279092346</nova:project>
Apr 11 22:10:59 user nova-compute[71364]:       </nova:owner>
Apr 11 22:10:59 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:10:59 user nova-compute[71364]:       <nova:ports>
Apr 11 22:10:59 user nova-compute[71364]:         <nova:port uuid="6c0af63c-303d-44dd-acb5-0b939a80a8f3">
Apr 11 22:10:59 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 11 22:10:59 user nova-compute[71364]:         </nova:port>
Apr 11 22:10:59 user nova-compute[71364]:       </nova:ports>
Apr 11 22:10:59 user nova-compute[71364]:     </nova:instance>
Apr 11 22:10:59 user nova-compute[71364]:   </metadata>
Apr 11 22:10:59 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:10:59 user nova-compute[71364]:     <system>
Apr 11 22:10:59 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:10:59 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:10:59 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:10:59 user nova-compute[71364]:       <entry name="serial">8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef</entry>
Apr 11 22:10:59 user nova-compute[71364]:       <entry name="uuid">8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef</entry>
Apr 11 22:10:59 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:10:59 user nova-compute[71364]:     </system>
Apr 11 22:10:59 user nova-compute[71364]:   </sysinfo>
Apr 11 22:10:59 user nova-compute[71364]:   <os>
Apr 11 22:10:59 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:10:59 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:10:59 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:10:59 user nova-compute[71364]:   </os>
Apr 11 22:10:59 user nova-compute[71364]:   <features>
Apr 11 22:10:59 user nova-compute[71364]:     <acpi/>
Apr 11 22:10:59 user nova-compute[71364]:     <apic/>
Apr 11 22:10:59 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:10:59 user nova-compute[71364]:   </features>
Apr 11 22:10:59 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:10:59 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:10:59 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:10:59 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:10:59 user nova-compute[71364]:   </clock>
Apr 11 22:10:59 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:10:59 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:10:59 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:10:59 user nova-compute[71364]:   </cpu>
Apr 11 22:10:59 user nova-compute[71364]:   <devices>
Apr 11 22:10:59 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:10:59 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:10:59 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk"/>
Apr 11 22:10:59 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:10:59 user nova-compute[71364]:     </disk>
Apr 11 22:10:59 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:10:59 user nova-compute[71364]:       <mac address="fa:16:3e:f6:18:9c"/>
Apr 11 22:10:59 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:10:59 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:10:59 user nova-compute[71364]:       <target dev="tap6c0af63c-30"/>
Apr 11 22:10:59 user nova-compute[71364]:     </interface>
Apr 11 22:10:59 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:10:59 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/console.log" append="off"/>
Apr 11 22:10:59 user nova-compute[71364]:     </serial>
Apr 11 22:10:59 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:10:59 user nova-compute[71364]:     <video>
Apr 11 22:10:59 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:10:59 user nova-compute[71364]:     </video>
Apr 11 22:10:59 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:10:59 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:10:59 user nova-compute[71364]:     </rng>
Apr 11 22:10:59 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:10:59 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:10:59 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:10:59 user nova-compute[71364]:     </memballoon>
Apr 11 22:10:59 user nova-compute[71364]:   </devices>
Apr 11 22:10:59 user nova-compute[71364]: </domain>
Apr 11 22:10:59 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-845148370',display_name='tempest-VolumesSnapshotTestJSON-instance-845148370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-845148370',id=36,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b2e33082edb407983882075d3237264',ramdisk_id='',reservation_id='r-tmryv04l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-279092346',owner_user_name='tempest-VolumesSnapshotTestJSON-279092346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:10:57Z,user_data=None,user_id='d28c7ae9f6dc4f06a7202bcab3afb0ac',uuid=8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "address": "fa:16:3e:f6:18:9c", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0af63c-30", "ovs_interfaceid": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Converting VIF {"id": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "address": "fa:16:3e:f6:18:9c", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0af63c-30", "ovs_interfaceid": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=6c0af63c-303d-44dd-acb5-0b939a80a8f3,network=Network(65f8b365-752d-40d7-aa38-7980a188a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c0af63c-30') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG os_vif [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=6c0af63c-303d-44dd-acb5-0b939a80a8f3,network=Network(65f8b365-752d-40d7-aa38-7980a188a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c0af63c-30') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c0af63c-30, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6c0af63c-30, col_values=(('external_ids', {'iface-id': '6c0af63c-303d-44dd-acb5-0b939a80a8f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:18:9c', 'vm-uuid': '8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:10:59 user nova-compute[71364]: INFO os_vif [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=6c0af63c-303d-44dd-acb5-0b939a80a8f3,network=Network(65f8b365-752d-40d7-aa38-7980a188a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c0af63c-30')
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] No VIF found with MAC fa:16:3e:f6:18:9c, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.network.neutron [req-e6f8db04-7741-439b-bbd0-e7264cdff103 req-3f7df433-529b-4f20-9a6b-e2974e9cdb10 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Updated VIF entry in instance network info cache for port 6c0af63c-303d-44dd-acb5-0b939a80a8f3. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:10:59 user nova-compute[71364]: DEBUG nova.network.neutron [req-e6f8db04-7741-439b-bbd0-e7264cdff103 req-3f7df433-529b-4f20-9a6b-e2974e9cdb10 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Updating instance_info_cache with network_info: [{"id": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "address": "fa:16:3e:f6:18:9c", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0af63c-30", "ovs_interfaceid": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:11:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e6f8db04-7741-439b-bbd0-e7264cdff103 req-3f7df433-529b-4f20-9a6b-e2974e9cdb10 service nova] Releasing lock "refresh_cache-8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:11:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:01 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:11:01 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:11:01 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 22:11:01 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] There are 0 instances to clean {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 22:11:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-7fc346f3-c999-4ba9-83a6-9609762c6646 req-41d16dd6-d08c-43b4-b7e5-f1d0ae1ec150 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Received event network-vif-plugged-6c0af63c-303d-44dd-acb5-0b939a80a8f3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:11:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7fc346f3-c999-4ba9-83a6-9609762c6646 req-41d16dd6-d08c-43b4-b7e5-f1d0ae1ec150 service nova] Acquiring lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:11:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7fc346f3-c999-4ba9-83a6-9609762c6646 req-41d16dd6-d08c-43b4-b7e5-f1d0ae1ec150 service nova] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:11:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7fc346f3-c999-4ba9-83a6-9609762c6646 req-41d16dd6-d08c-43b4-b7e5-f1d0ae1ec150 service nova] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-7fc346f3-c999-4ba9-83a6-9609762c6646 req-41d16dd6-d08c-43b4-b7e5-f1d0ae1ec150 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] No waiting events found dispatching network-vif-plugged-6c0af63c-303d-44dd-acb5-0b939a80a8f3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:11:01 user nova-compute[71364]: WARNING nova.compute.manager [req-7fc346f3-c999-4ba9-83a6-9609762c6646 req-41d16dd6-d08c-43b4-b7e5-f1d0ae1ec150 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Received unexpected event network-vif-plugged-6c0af63c-303d-44dd-acb5-0b939a80a8f3 for instance with vm_state building and task_state spawning.
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251063.1329591, 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:11:03 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] VM Resumed (Lifecycle Event)
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:11:03 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Instance spawned successfully.
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:11:03 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251063.134218, 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:11:03 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] VM Started (Lifecycle Event)
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:11:03 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:11:03 user nova-compute[71364]: INFO nova.compute.manager [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Took 5.74 seconds to spawn the instance on the hypervisor.
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:03 user nova-compute[71364]: INFO nova.compute.manager [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Took 6.52 seconds to build instance.
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.663s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-f038bf43-39db-4032-b16c-3e780b1df6f9 req-b2db64c0-070f-45f8-86e2-2a988c06a3f1 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Received event network-vif-plugged-6c0af63c-303d-44dd-acb5-0b939a80a8f3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f038bf43-39db-4032-b16c-3e780b1df6f9 req-b2db64c0-070f-45f8-86e2-2a988c06a3f1 service nova] Acquiring lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f038bf43-39db-4032-b16c-3e780b1df6f9 req-b2db64c0-070f-45f8-86e2-2a988c06a3f1 service nova] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f038bf43-39db-4032-b16c-3e780b1df6f9 req-b2db64c0-070f-45f8-86e2-2a988c06a3f1 service nova] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-f038bf43-39db-4032-b16c-3e780b1df6f9 req-b2db64c0-070f-45f8-86e2-2a988c06a3f1 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] No waiting events found dispatching network-vif-plugged-6c0af63c-303d-44dd-acb5-0b939a80a8f3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:11:03 user nova-compute[71364]: WARNING nova.compute.manager [req-f038bf43-39db-4032-b16c-3e780b1df6f9 req-b2db64c0-070f-45f8-86e2-2a988c06a3f1 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Received unexpected event network-vif-plugged-6c0af63c-303d-44dd-acb5-0b939a80a8f3 for instance with vm_state active and task_state None.
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:05 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:11:05 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8226MB free_disk=26.096519470214844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d6268190-2187-4596-9f0b-026c520e5c67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing inventories for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating ProviderTree inventory for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating inventory in ProviderTree for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing aggregate associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, aggregates: None {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 22:11:05 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing trait associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 22:11:06 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:11:06 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:11:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:11:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.706s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:11:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:11:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:11:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:11:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:11:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:11:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:11:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:11:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:11:10 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:11:10 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Updating instance_info_cache with network_info: [{"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:11:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-c48d8944-6010-4d8d-9761-6ee0d7cd005b" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:11:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:11:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:11:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:11:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:11:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:11:10 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:11:11 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:11:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:11:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71364) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 22:11:13 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:11:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:15 user nova-compute[71364]: INFO nova.compute.manager [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Terminating instance
Apr 11 22:11:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-60799ab9-ca3f-4046-b107-8b0a6f27d528 req-a6906297-9b23-440a-95cd-49a797fcf065 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-vif-unplugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-60799ab9-ca3f-4046-b107-8b0a6f27d528 req-a6906297-9b23-440a-95cd-49a797fcf065 service nova] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-60799ab9-ca3f-4046-b107-8b0a6f27d528 req-a6906297-9b23-440a-95cd-49a797fcf065 service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-60799ab9-ca3f-4046-b107-8b0a6f27d528 req-a6906297-9b23-440a-95cd-49a797fcf065 service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-60799ab9-ca3f-4046-b107-8b0a6f27d528 req-a6906297-9b23-440a-95cd-49a797fcf065 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] No waiting events found dispatching network-vif-unplugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-60799ab9-ca3f-4046-b107-8b0a6f27d528 req-a6906297-9b23-440a-95cd-49a797fcf065 service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-vif-unplugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:15 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Instance destroyed successfully.
Apr 11 22:11:15 user nova-compute[71364]: DEBUG nova.objects.instance [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'resources' on Instance uuid 3b74e50d-0c81-4c84-a97a-2e22a0524a93 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-681651975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-681651975',id=32,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:07:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53057a8fc17e400e8c26a7dec2c873f9',ramdisk_id='',reservation_id='r-7bjmu0w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:09:29Z,user_data=None,user_id='10430313a8b44e6794ca88d30a83c69a',uuid=3b74e50d-0c81-4c84-a97a-2e22a0524a93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converting VIF {"id": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "address": "fa:16:3e:60:74:fd", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f82f3bd-eb", "ovs_interfaceid": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:74:fd,bridge_name='br-int',has_traffic_filtering=True,id=0f82f3bd-eb56-4b1a-aed6-7b4159cc1852,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f82f3bd-eb') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG os_vif [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:74:fd,bridge_name='br-int',has_traffic_filtering=True,id=0f82f3bd-eb56-4b1a-aed6-7b4159cc1852,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f82f3bd-eb') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f82f3bd-eb, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:15 user nova-compute[71364]: INFO os_vif [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:74:fd,bridge_name='br-int',has_traffic_filtering=True,id=0f82f3bd-eb56-4b1a-aed6-7b4159cc1852,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f82f3bd-eb')
Apr 11 22:11:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCxnpyJT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:11:15 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:11:15 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1d880f-45cb-455d-95b4-b4e13366b594]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:11:15 user nova-compute[71364]: No targets found.
Apr 11 22:11:15 user nova-compute[71364]: iSNS:
Apr 11 22:11:15 user nova-compute[71364]: No targets found.
Apr 11 22:11:15 user nova-compute[71364]: STATIC:
Apr 11 22:11:15 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:11:15 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:11:15 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:11:15 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba
Apr 11 22:11:15 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:11:15 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:11:15 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c
Apr 11 22:11:15 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:11:15 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:11:15 user nova-compute[71364]: FIRMWARE:
Apr 11 22:11:15 user nova-compute[71364]: No targets found.
Apr 11 22:11:15 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:11:15 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:11:15 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:11:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9190b0-7222-43ac-a1ea-1e176ca11a4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f436e407-0394-43ba-8456-583b7e25deec]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:11:16 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:11:16 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:11:16 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:11:16 user nova-compute[71364]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba (non-flash)
Apr 11 22:11:16 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:11:16 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bf0296e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba'): ({'sdd'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Removing single pathed devices sdd {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5326c4-4265-471d-8f2a-ade3684a949f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c081e5d-df7a-4f31-92af-959196a16848]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flushing IO for device /dev/sdd {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c536d7e-ae9a-4985-aebd-a43c8820ceb4]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c621b761-8bea-4cf8-84c4-47d4e9a64e9c]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23365356339626531', '/dev/disk/by-id/scsi-1SCST_BIO10b0164d-3e5c9be1b4a9831c', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_10b0164d') {{(pid=81576) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bb21a7-a966-4ee8-8e78-3c9855787a26]: (4, None) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cae098d-6c4e-47e5-9fd9-db0d8cdb8e95]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4c02db-a9d2-407d-a03c-50d9ff2ca3bd]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba, portal: 172.16.0.220,3260]
Apr 11 22:11:16 user nova-compute[71364]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba, portal: 172.16.0.220,3260] successful.
Apr 11 22:11:16 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a70f8fe-561d-4836-b2b4-775fe6e2b4ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[110ebab3-4fdc-4bf2-a1ce-18db096b6fc8]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] <== disconnect_volume: return (331ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:11:16 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Deleting instance files /opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93_del
Apr 11 22:11:16 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Deletion of /opt/stack/data/nova/instances/3b74e50d-0c81-4c84-a97a-2e22a0524a93_del complete
Apr 11 22:11:16 user nova-compute[71364]: INFO nova.compute.manager [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 11 22:11:16 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:11:16 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:11:16 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Took 0.43 seconds to deallocate network for instance.
Apr 11 22:11:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-e5ac9f25-66f9-4421-ab76-a9b1dc377cb3 req-0314c9b4-6a8b-4d7d-98c2-fe0ec1d5d15b service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:11:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e5ac9f25-66f9-4421-ab76-a9b1dc377cb3 req-0314c9b4-6a8b-4d7d-98c2-fe0ec1d5d15b service nova] Acquiring lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:11:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e5ac9f25-66f9-4421-ab76-a9b1dc377cb3 req-0314c9b4-6a8b-4d7d-98c2-fe0ec1d5d15b service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:11:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e5ac9f25-66f9-4421-ab76-a9b1dc377cb3 req-0314c9b4-6a8b-4d7d-98c2-fe0ec1d5d15b service nova] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-e5ac9f25-66f9-4421-ab76-a9b1dc377cb3 req-0314c9b4-6a8b-4d7d-98c2-fe0ec1d5d15b service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] No waiting events found dispatching network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:11:17 user nova-compute[71364]: WARNING nova.compute.manager [req-e5ac9f25-66f9-4421-ab76-a9b1dc377cb3 req-0314c9b4-6a8b-4d7d-98c2-fe0ec1d5d15b service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received unexpected event network-vif-plugged-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance with vm_state active and task_state deleting.
Apr 11 22:11:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-e5ac9f25-66f9-4421-ab76-a9b1dc377cb3 req-0314c9b4-6a8b-4d7d-98c2-fe0ec1d5d15b service nova] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Received event network-vif-deleted-0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:11:17 user nova-compute[71364]: INFO nova.compute.manager [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Took 0.77 seconds to detach 1 volumes for instance.
Apr 11 22:11:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:11:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:11:17 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:11:17 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:11:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:17 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Deleted allocations for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93
Apr 11 22:11:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "3b74e50d-0c81-4c84-a97a-2e22a0524a93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.901s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:11:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:11:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:11:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:11:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:22 user nova-compute[71364]: INFO nova.compute.manager [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Terminating instance
Apr 11 22:11:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:11:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-861b3e0c-1496-4fc5-81b0-d0a749d2def9 req-c91d3a36-8224-453a-a70a-9afc7c1bc50e service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-vif-unplugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-861b3e0c-1496-4fc5-81b0-d0a749d2def9 req-c91d3a36-8224-453a-a70a-9afc7c1bc50e service nova] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-861b3e0c-1496-4fc5-81b0-d0a749d2def9 req-c91d3a36-8224-453a-a70a-9afc7c1bc50e service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-861b3e0c-1496-4fc5-81b0-d0a749d2def9 req-c91d3a36-8224-453a-a70a-9afc7c1bc50e service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-861b3e0c-1496-4fc5-81b0-d0a749d2def9 req-c91d3a36-8224-453a-a70a-9afc7c1bc50e service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] No waiting events found dispatching network-vif-unplugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-861b3e0c-1496-4fc5-81b0-d0a749d2def9 req-c91d3a36-8224-453a-a70a-9afc7c1bc50e service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-vif-unplugged-809749e4-0885-4825-8976-660b2c0bcca7 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:11:23 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Instance destroyed successfully.
Apr 11 22:11:23 user nova-compute[71364]: DEBUG nova.objects.instance [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'resources' on Instance uuid b66951a9-73f3-41ce-9f19-b4e5e24d61b0 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1390553747',display_name='tempest-ServerRescueNegativeTestJSON-server-1390553747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1390553747',id=17,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:59:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c35707743988462887127e06825cd483',ramdisk_id='',reservation_id='r-taxw1lk4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-797099247',owner_user_name='tempest-ServerRescueNegativeTestJSON-797099247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:01:16Z,user_data=None,user_id='546f0a94a2ad450ead596252c786839e',uuid=b66951a9-73f3-41ce-9f19-b4e5e24d61b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converting VIF {"id": "809749e4-0885-4825-8976-660b2c0bcca7", "address": "fa:16:3e:4a:7c:1e", "network": {"id": "ddda60f7-a538-40d5-a275-9095802151f7", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1425914198-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c35707743988462887127e06825cd483", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap809749e4-08", "ovs_interfaceid": "809749e4-0885-4825-8976-660b2c0bcca7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:7c:1e,bridge_name='br-int',has_traffic_filtering=True,id=809749e4-0885-4825-8976-660b2c0bcca7,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809749e4-08') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG os_vif [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:7c:1e,bridge_name='br-int',has_traffic_filtering=True,id=809749e4-0885-4825-8976-660b2c0bcca7,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809749e4-08') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap809749e4-08, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:23 user nova-compute[71364]: INFO os_vif [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:7c:1e,bridge_name='br-int',has_traffic_filtering=True,id=809749e4-0885-4825-8976-660b2c0bcca7,network=Network(ddda60f7-a538-40d5-a275-9095802151f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap809749e4-08')
Apr 11 22:11:23 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Deleting instance files /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0_del
Apr 11 22:11:23 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Deletion of /opt/stack/data/nova/instances/b66951a9-73f3-41ce-9f19-b4e5e24d61b0_del complete
Apr 11 22:11:23 user nova-compute[71364]: INFO nova.compute.manager [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 11 22:11:23 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:11:23 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:11:24 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:11:24 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Took 0.54 seconds to deallocate network for instance.
Apr 11 22:11:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-34d25475-17bf-4f47-9318-53df1c1baf0b req-4121f27a-20a3-4f4a-b489-23de847b0a99 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-vif-deleted-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:11:24 user nova-compute[71364]: INFO nova.compute.manager [req-34d25475-17bf-4f47-9318-53df1c1baf0b req-4121f27a-20a3-4f4a-b489-23de847b0a99 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Neutron deleted interface 809749e4-0885-4825-8976-660b2c0bcca7; detaching it from the instance and deleting it from the info cache
Apr 11 22:11:24 user nova-compute[71364]: DEBUG nova.network.neutron [req-34d25475-17bf-4f47-9318-53df1c1baf0b req-4121f27a-20a3-4f4a-b489-23de847b0a99 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:11:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-34d25475-17bf-4f47-9318-53df1c1baf0b req-4121f27a-20a3-4f4a-b489-23de847b0a99 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Detach interface failed, port_id=809749e4-0885-4825-8976-660b2c0bcca7, reason: Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 22:11:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:11:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:11:24 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:11:24 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:11:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:24 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Deleted allocations for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0
Apr 11 22:11:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.155s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-401161c1-1fc9-463e-a74f-02d863bb20cb req-ec98cf2c-2ea7-40fa-9de0-ab73db8b47f1 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:11:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-401161c1-1fc9-463e-a74f-02d863bb20cb req-ec98cf2c-2ea7-40fa-9de0-ab73db8b47f1 service nova] Acquiring lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:11:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-401161c1-1fc9-463e-a74f-02d863bb20cb req-ec98cf2c-2ea7-40fa-9de0-ab73db8b47f1 service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:11:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-401161c1-1fc9-463e-a74f-02d863bb20cb req-ec98cf2c-2ea7-40fa-9de0-ab73db8b47f1 service nova] Lock "b66951a9-73f3-41ce-9f19-b4e5e24d61b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:11:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-401161c1-1fc9-463e-a74f-02d863bb20cb req-ec98cf2c-2ea7-40fa-9de0-ab73db8b47f1 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] No waiting events found dispatching network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:11:25 user nova-compute[71364]: WARNING nova.compute.manager [req-401161c1-1fc9-463e-a74f-02d863bb20cb req-ec98cf2c-2ea7-40fa-9de0-ab73db8b47f1 service nova] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Received unexpected event network-vif-plugged-809749e4-0885-4825-8976-660b2c0bcca7 for instance with vm_state deleted and task_state None.
Apr 11 22:11:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:30 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251075.9185588, 3b74e50d-0c81-4c84-a97a-2e22a0524a93 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:11:30 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] VM Stopped (Lifecycle Event)
Apr 11 22:11:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3bc5af18-0669-442e-9132-c87a2d67d703 None None] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:11:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:38 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251083.6614585, b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:11:38 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] VM Stopped (Lifecycle Event)
Apr 11 22:11:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-edff5954-9c8d-48db-9ee0-86835ad4d131 None None] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:11:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:11:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:11:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:11:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:11:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:11:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:51 user nova-compute[71364]: INFO nova.compute.manager [None req-fe571dc8-5fed-47a4-a885-449f8202b241 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Get console output
Apr 11 22:11:51 user nova-compute[71364]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 11 22:11:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:11:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:04 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:12:04 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:12:04 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8360MB free_disk=26.077957153320312GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance d6268190-2187-4596-9f0b-026c520e5c67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:12:04 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:12:05 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:12:05 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:12:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:12:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "d6268190-2187-4596-9f0b-026c520e5c67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "d6268190-2187-4596-9f0b-026c520e5c67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "d6268190-2187-4596-9f0b-026c520e5c67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "d6268190-2187-4596-9f0b-026c520e5c67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "d6268190-2187-4596-9f0b-026c520e5c67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:06 user nova-compute[71364]: INFO nova.compute.manager [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Terminating instance
Apr 11 22:12:06 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-05a0b996-8ed3-4744-b015-121bc5f381f0 req-eca37fdc-144d-4912-b8c1-92c85a3c401c service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Received event network-vif-unplugged-44ef8405-caf6-4408-985a-654d964ae175 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-05a0b996-8ed3-4744-b015-121bc5f381f0 req-eca37fdc-144d-4912-b8c1-92c85a3c401c service nova] Acquiring lock "d6268190-2187-4596-9f0b-026c520e5c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-05a0b996-8ed3-4744-b015-121bc5f381f0 req-eca37fdc-144d-4912-b8c1-92c85a3c401c service nova] Lock "d6268190-2187-4596-9f0b-026c520e5c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-05a0b996-8ed3-4744-b015-121bc5f381f0 req-eca37fdc-144d-4912-b8c1-92c85a3c401c service nova] Lock "d6268190-2187-4596-9f0b-026c520e5c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-05a0b996-8ed3-4744-b015-121bc5f381f0 req-eca37fdc-144d-4912-b8c1-92c85a3c401c service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] No waiting events found dispatching network-vif-unplugged-44ef8405-caf6-4408-985a-654d964ae175 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-05a0b996-8ed3-4744-b015-121bc5f381f0 req-eca37fdc-144d-4912-b8c1-92c85a3c401c service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Received event network-vif-unplugged-44ef8405-caf6-4408-985a-654d964ae175 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:12:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Instance destroyed successfully.
Apr 11 22:12:06 user nova-compute[71364]: DEBUG nova.objects.instance [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'resources' on Instance uuid d6268190-2187-4596-9f0b-026c520e5c67 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:02:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1363289369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1363289369',id=28,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:02:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53057a8fc17e400e8c26a7dec2c873f9',ramdisk_id='',reservation_id='r-3ltev9nc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:04:40Z,user_data=None,user_id='10430313a8b44e6794ca88d30a83c69a',uuid=d6268190-2187-4596-9f0b-026c520e5c67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44ef8405-caf6-4408-985a-654d964ae175", "address": "fa:16:3e:0d:e3:24", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44ef8405-ca", "ovs_interfaceid": "44ef8405-caf6-4408-985a-654d964ae175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converting VIF {"id": "44ef8405-caf6-4408-985a-654d964ae175", "address": "fa:16:3e:0d:e3:24", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44ef8405-ca", "ovs_interfaceid": "44ef8405-caf6-4408-985a-654d964ae175", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:e3:24,bridge_name='br-int',has_traffic_filtering=True,id=44ef8405-caf6-4408-985a-654d964ae175,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44ef8405-ca') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG os_vif [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:e3:24,bridge_name='br-int',has_traffic_filtering=True,id=44ef8405-caf6-4408-985a-654d964ae175,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44ef8405-ca') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44ef8405-ca, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:12:06 user nova-compute[71364]: INFO os_vif [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:e3:24,bridge_name='br-int',has_traffic_filtering=True,id=44ef8405-caf6-4408-985a-654d964ae175,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44ef8405-ca')
Apr 11 22:12:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Deleting instance files /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67_del
Apr 11 22:12:06 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Deletion of /opt/stack/data/nova/instances/d6268190-2187-4596-9f0b-026c520e5c67_del complete
Apr 11 22:12:06 user nova-compute[71364]: INFO nova.compute.manager [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 11 22:12:06 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:12:06 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: d6268190-2187-4596-9f0b-026c520e5c67] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:12:07 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:12:07 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Took 0.45 seconds to deallocate network for instance.
Apr 11 22:12:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-ac5ba6bf-d886-49e8-82c8-9e529c9e4460 req-d792ca61-176f-48f1-a0ed-be2deabf7407 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Received event network-vif-deleted-44ef8405-caf6-4408-985a-654d964ae175 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:12:07 user nova-compute[71364]: INFO nova.compute.manager [req-ac5ba6bf-d886-49e8-82c8-9e529c9e4460 req-d792ca61-176f-48f1-a0ed-be2deabf7407 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Neutron deleted interface 44ef8405-caf6-4408-985a-654d964ae175; detaching it from the instance and deleting it from the info cache
Apr 11 22:12:07 user nova-compute[71364]: DEBUG nova.network.neutron [req-ac5ba6bf-d886-49e8-82c8-9e529c9e4460 req-d792ca61-176f-48f1-a0ed-be2deabf7407 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:12:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-ac5ba6bf-d886-49e8-82c8-9e529c9e4460 req-d792ca61-176f-48f1-a0ed-be2deabf7407 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Detach interface failed, port_id=44ef8405-caf6-4408-985a-654d964ae175, reason: Instance d6268190-2187-4596-9f0b-026c520e5c67 could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 22:12:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:07 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:12:07 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:12:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:07 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Deleted allocations for instance d6268190-2187-4596-9f0b-026c520e5c67
Apr 11 22:12:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "d6268190-2187-4596-9f0b-026c520e5c67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.501s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-90a2dbcc-5227-41e2-99d8-2a638b005600 req-1968d447-e73c-44d1-8b3f-9876a07f2b12 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Received event network-vif-plugged-44ef8405-caf6-4408-985a-654d964ae175 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:12:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-90a2dbcc-5227-41e2-99d8-2a638b005600 req-1968d447-e73c-44d1-8b3f-9876a07f2b12 service nova] Acquiring lock "d6268190-2187-4596-9f0b-026c520e5c67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-90a2dbcc-5227-41e2-99d8-2a638b005600 req-1968d447-e73c-44d1-8b3f-9876a07f2b12 service nova] Lock "d6268190-2187-4596-9f0b-026c520e5c67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-90a2dbcc-5227-41e2-99d8-2a638b005600 req-1968d447-e73c-44d1-8b3f-9876a07f2b12 service nova] Lock "d6268190-2187-4596-9f0b-026c520e5c67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-90a2dbcc-5227-41e2-99d8-2a638b005600 req-1968d447-e73c-44d1-8b3f-9876a07f2b12 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] No waiting events found dispatching network-vif-plugged-44ef8405-caf6-4408-985a-654d964ae175 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:12:08 user nova-compute[71364]: WARNING nova.compute.manager [req-90a2dbcc-5227-41e2-99d8-2a638b005600 req-1968d447-e73c-44d1-8b3f-9876a07f2b12 service nova] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Received unexpected event network-vif-plugged-44ef8405-caf6-4408-985a-654d964ae175 for instance with vm_state deleted and task_state None.
Apr 11 22:12:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:12:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:12:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:12:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:12:09 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:12:09 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Updating instance_info_cache with network_info: [{"id": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "address": "fa:16:3e:89:4e:e1", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184fffcb-75", "ovs_interfaceid": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:12:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-9e44ad56-d695-409c-9d35-3d3dec2c3a89" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:12:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:12:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:12:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:12:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:12:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:12:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:12:11 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:12:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:12:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:12:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:21 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251126.797017, d6268190-2187-4596-9f0b-026c520e5c67 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:12:21 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: d6268190-2187-4596-9f0b-026c520e5c67] VM Stopped (Lifecycle Event)
Apr 11 22:12:21 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a39d8dcd-3096-4614-9a21-9c520b83a448 None None] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:12:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:12:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:26 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:12:26 user nova-compute[71364]: INFO nova.compute.claims [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Claim successful on node user
Apr 11 22:12:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:26 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:12:26 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:12:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG nova.network.neutron [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:12:27 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:12:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG nova.policy [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:12:27 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Creating image(s)
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "/opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "/opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "/opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk 1073741824" returned: 0 in 0.049s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Cannot resize image /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG nova.objects.instance [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'migration_context' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG nova.network.neutron [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Successfully created port: 04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Ensure instance console log exists: /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.network.neutron [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Successfully updated port: 04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquired lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.network.neutron [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.compute.manager [req-4a0530ad-4149-4d06-977e-da4140d615a2 req-8f6a0a29-feff-4646-af84-7f98120531d8 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received event network-changed-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.compute.manager [req-4a0530ad-4149-4d06-977e-da4140d615a2 req-8f6a0a29-feff-4646-af84-7f98120531d8 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Refreshing instance network info cache due to event network-changed-04ca38ad-28b6-4863-ad00-2d83b8d40fa9. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a0530ad-4149-4d06-977e-da4140d615a2 req-8f6a0a29-feff-4646-af84-7f98120531d8 service nova] Acquiring lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.network.neutron [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.network.neutron [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updating instance_info_cache with network_info: [{"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Releasing lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Instance network_info: |[{"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a0530ad-4149-4d06-977e-da4140d615a2 req-8f6a0a29-feff-4646-af84-7f98120531d8 service nova] Acquired lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.network.neutron [req-4a0530ad-4149-4d06-977e-da4140d615a2 req-8f6a0a29-feff-4646-af84-7f98120531d8 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Refreshing network info cache for port 04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Start _get_guest_xml network_info=[{"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:12:28 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:12:28 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1059229540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1059229540',id=37,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMatx2BIJDvb1/qWBbpl5ESBBxq/iMRYOnc9wjSJgIdAqgjjdFvwNzCgMnXbgpSi0jypGAgU2YpKOIBtnQi+JlOyNHiSni3dJBuvkgEe7mmK3+ZRHrtLRf+cvKNcO+lE4g==',key_name='tempest-keypair-2035792703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29e79d7c2e144af59f911973e79ba110',ramdisk_id='',reservation_id='r-f90giz2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-590407943',owner_user_name='tempest-AttachVolumeShelveTestJSON-590407943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:12:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5898621881a4e799df121e1d5957f42',uuid=3331e482-bd81-47da-9e66-eade6dd2edcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converting VIF {"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:31:e4,bridge_name='br-int',has_traffic_filtering=True,id=04ca38ad-28b6-4863-ad00-2d83b8d40fa9,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca38ad-28') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.objects.instance [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'pci_devices' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:12:28 user nova-compute[71364]:   <uuid>3331e482-bd81-47da-9e66-eade6dd2edcc</uuid>
Apr 11 22:12:28 user nova-compute[71364]:   <name>instance-00000025</name>
Apr 11 22:12:28 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:12:28 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:12:28 user nova-compute[71364]:   <metadata>
Apr 11 22:12:28 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:12:28 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:12:28 user nova-compute[71364]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1059229540</nova:name>
Apr 11 22:12:28 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:12:28</nova:creationTime>
Apr 11 22:12:28 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:12:28 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:12:28 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:12:28 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:12:28 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:12:28 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:12:28 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:12:28 user nova-compute[71364]:       <nova:owner>
Apr 11 22:12:28 user nova-compute[71364]:         <nova:user uuid="e5898621881a4e799df121e1d5957f42">tempest-AttachVolumeShelveTestJSON-590407943-project-member</nova:user>
Apr 11 22:12:28 user nova-compute[71364]:         <nova:project uuid="29e79d7c2e144af59f911973e79ba110">tempest-AttachVolumeShelveTestJSON-590407943</nova:project>
Apr 11 22:12:28 user nova-compute[71364]:       </nova:owner>
Apr 11 22:12:28 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:12:28 user nova-compute[71364]:       <nova:ports>
Apr 11 22:12:28 user nova-compute[71364]:         <nova:port uuid="04ca38ad-28b6-4863-ad00-2d83b8d40fa9">
Apr 11 22:12:28 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 22:12:28 user nova-compute[71364]:         </nova:port>
Apr 11 22:12:28 user nova-compute[71364]:       </nova:ports>
Apr 11 22:12:28 user nova-compute[71364]:     </nova:instance>
Apr 11 22:12:28 user nova-compute[71364]:   </metadata>
Apr 11 22:12:28 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:12:28 user nova-compute[71364]:     <system>
Apr 11 22:12:28 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:12:28 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:12:28 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:12:28 user nova-compute[71364]:       <entry name="serial">3331e482-bd81-47da-9e66-eade6dd2edcc</entry>
Apr 11 22:12:28 user nova-compute[71364]:       <entry name="uuid">3331e482-bd81-47da-9e66-eade6dd2edcc</entry>
Apr 11 22:12:28 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:12:28 user nova-compute[71364]:     </system>
Apr 11 22:12:28 user nova-compute[71364]:   </sysinfo>
Apr 11 22:12:28 user nova-compute[71364]:   <os>
Apr 11 22:12:28 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:12:28 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:12:28 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:12:28 user nova-compute[71364]:   </os>
Apr 11 22:12:28 user nova-compute[71364]:   <features>
Apr 11 22:12:28 user nova-compute[71364]:     <acpi/>
Apr 11 22:12:28 user nova-compute[71364]:     <apic/>
Apr 11 22:12:28 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:12:28 user nova-compute[71364]:   </features>
Apr 11 22:12:28 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:12:28 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:12:28 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:12:28 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:12:28 user nova-compute[71364]:   </clock>
Apr 11 22:12:28 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:12:28 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:12:28 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:12:28 user nova-compute[71364]:   </cpu>
Apr 11 22:12:28 user nova-compute[71364]:   <devices>
Apr 11 22:12:28 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:12:28 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:12:28 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk"/>
Apr 11 22:12:28 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:12:28 user nova-compute[71364]:     </disk>
Apr 11 22:12:28 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:12:28 user nova-compute[71364]:       <mac address="fa:16:3e:da:31:e4"/>
Apr 11 22:12:28 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:12:28 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:12:28 user nova-compute[71364]:       <target dev="tap04ca38ad-28"/>
Apr 11 22:12:28 user nova-compute[71364]:     </interface>
Apr 11 22:12:28 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:12:28 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/console.log" append="off"/>
Apr 11 22:12:28 user nova-compute[71364]:     </serial>
Apr 11 22:12:28 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:12:28 user nova-compute[71364]:     <video>
Apr 11 22:12:28 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:12:28 user nova-compute[71364]:     </video>
Apr 11 22:12:28 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:12:28 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:12:28 user nova-compute[71364]:     </rng>
Apr 11 22:12:28 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:12:28 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:12:28 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:12:28 user nova-compute[71364]:     </memballoon>
Apr 11 22:12:28 user nova-compute[71364]:   </devices>
Apr 11 22:12:28 user nova-compute[71364]: </domain>
Apr 11 22:12:28 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1059229540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1059229540',id=37,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMatx2BIJDvb1/qWBbpl5ESBBxq/iMRYOnc9wjSJgIdAqgjjdFvwNzCgMnXbgpSi0jypGAgU2YpKOIBtnQi+JlOyNHiSni3dJBuvkgEe7mmK3+ZRHrtLRf+cvKNcO+lE4g==',key_name='tempest-keypair-2035792703',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29e79d7c2e144af59f911973e79ba110',ramdisk_id='',reservation_id='r-f90giz2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-590407943',owner_user_name='tempest-AttachVolumeShelveTestJSON-590407943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:12:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5898621881a4e799df121e1d5957f42',uuid=3331e482-bd81-47da-9e66-eade6dd2edcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converting VIF {"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:31:e4,bridge_name='br-int',has_traffic_filtering=True,id=04ca38ad-28b6-4863-ad00-2d83b8d40fa9,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca38ad-28') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG os_vif [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:31:e4,bridge_name='br-int',has_traffic_filtering=True,id=04ca38ad-28b6-4863-ad00-2d83b8d40fa9,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca38ad-28') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04ca38ad-28, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04ca38ad-28, col_values=(('external_ids', {'iface-id': '04ca38ad-28b6-4863-ad00-2d83b8d40fa9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:31:e4', 'vm-uuid': '3331e482-bd81-47da-9e66-eade6dd2edcc'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:12:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:28 user nova-compute[71364]: INFO os_vif [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:31:e4,bridge_name='br-int',has_traffic_filtering=True,id=04ca38ad-28b6-4863-ad00-2d83b8d40fa9,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca38ad-28')
Apr 11 22:12:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:12:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] No VIF found with MAC fa:16:3e:da:31:e4, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:12:29 user nova-compute[71364]: DEBUG nova.network.neutron [req-4a0530ad-4149-4d06-977e-da4140d615a2 req-8f6a0a29-feff-4646-af84-7f98120531d8 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updated VIF entry in instance network info cache for port 04ca38ad-28b6-4863-ad00-2d83b8d40fa9. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:12:29 user nova-compute[71364]: DEBUG nova.network.neutron [req-4a0530ad-4149-4d06-977e-da4140d615a2 req-8f6a0a29-feff-4646-af84-7f98120531d8 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updating instance_info_cache with network_info: [{"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:12:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4a0530ad-4149-4d06-977e-da4140d615a2 req-8f6a0a29-feff-4646-af84-7f98120531d8 service nova] Releasing lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:12:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-c394b72e-120a-4e64-b832-ce2619c8dd24 req-aa31544f-f355-431c-b287-3ed07d61fbe4 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received event network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:12:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c394b72e-120a-4e64-b832-ce2619c8dd24 req-aa31544f-f355-431c-b287-3ed07d61fbe4 service nova] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c394b72e-120a-4e64-b832-ce2619c8dd24 req-aa31544f-f355-431c-b287-3ed07d61fbe4 service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c394b72e-120a-4e64-b832-ce2619c8dd24 req-aa31544f-f355-431c-b287-3ed07d61fbe4 service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-c394b72e-120a-4e64-b832-ce2619c8dd24 req-aa31544f-f355-431c-b287-3ed07d61fbe4 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] No waiting events found dispatching network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:12:30 user nova-compute[71364]: WARNING nova.compute.manager [req-c394b72e-120a-4e64-b832-ce2619c8dd24 req-aa31544f-f355-431c-b287-3ed07d61fbe4 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received unexpected event network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance with vm_state building and task_state spawning.
Apr 11 22:12:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251152.415259, 3331e482-bd81-47da-9e66-eade6dd2edcc => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:12:32 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] VM Resumed (Lifecycle Event)
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.compute.manager [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:12:32 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Instance spawned successfully.
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:12:32 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251152.4164853, 3331e482-bd81-47da-9e66-eade6dd2edcc => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:12:32 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] VM Started (Lifecycle Event)
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:12:32 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:12:32 user nova-compute[71364]: INFO nova.compute.manager [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Took 5.37 seconds to spawn the instance on the hypervisor.
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.compute.manager [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-6d5bad54-091d-4558-b8e6-5f806821d57c req-331b9147-0501-4138-b2b5-60882da6d52d service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received event network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6d5bad54-091d-4558-b8e6-5f806821d57c req-331b9147-0501-4138-b2b5-60882da6d52d service nova] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6d5bad54-091d-4558-b8e6-5f806821d57c req-331b9147-0501-4138-b2b5-60882da6d52d service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-6d5bad54-091d-4558-b8e6-5f806821d57c req-331b9147-0501-4138-b2b5-60882da6d52d service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-6d5bad54-091d-4558-b8e6-5f806821d57c req-331b9147-0501-4138-b2b5-60882da6d52d service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] No waiting events found dispatching network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:12:32 user nova-compute[71364]: WARNING nova.compute.manager [req-6d5bad54-091d-4558-b8e6-5f806821d57c req-331b9147-0501-4138-b2b5-60882da6d52d service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received unexpected event network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance with vm_state building and task_state spawning.
Apr 11 22:12:32 user nova-compute[71364]: INFO nova.compute.manager [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Took 6.00 seconds to build instance.
Apr 11 22:12:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.088s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:46 user nova-compute[71364]: DEBUG nova.objects.instance [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lazy-loading 'flavor' on Instance uuid 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:12:46 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Ignoring supplied device name: /dev/vdb
Apr 11 22:12:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:46 user nova-compute[71364]: INFO nova.compute.manager [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Attaching volume 328767e3-0dcc-4403-b8ef-223b9eab4900 to /dev/vdb
Apr 11 22:12:47 user nova-compute[71364]: DEBUG os_brick.utils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ed499f-8ec5-4eb8-aded-3da11ca5659b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c74f38-8c0b-45a1-a679-f9d80d0d5305]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff37dba-b200-4d49-85d6-234d517b7f69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59de347-391e-4f20-b6a9-16b03f2d1cd3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:12:47 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:12:47 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7764b2ce-d94d-452d-ae72-4873d0ba0072]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG os_brick.utils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:12:47 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Updating existing volume attachment record: cc20a1e5-4ade-4a75-a846-91bfaf6e1639 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:12:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIhQgOoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:12:51 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:12:51 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:12:51 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a615b0-2c6b-41a4-b6ad-655affca9e1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:12:51 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fab5ed7-ce63-48cd-8784-a94ede3794e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900] added
Apr 11 22:12:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70b2a02-c92e-468b-92e6-069f86987d3b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e645e6-100e-43db-a201-7e5a1c237655]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIhQgOoS {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sIhQgOoS" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b296acf7-e7a9-4dcb-91d0-5e0db51f8a16]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sIhQgOoS'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4fc2ff-1aaa-4c91-b38d-4dd2358a81ca]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[868df019-6df0-4fb5-a765-fffc007a98e2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:12:51 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:12:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:12:51 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:12:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25b0ec1-caea-4048-b567-bb7887f206fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900, portal: 172.16.0.220,3260]
Apr 11 22:12:51 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900, portal: 172.16.0.220,3260] successful.
Apr 11 22:12:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0bb0d5-8dde-441a-b7f5-53a5d216f89a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc8ece8-1c9b-41b0-9f09-cf5c530f4347]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:12:51 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:12:51 user nova-compute[71364]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 (non-flash)
Apr 11 22:12:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:12:51 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:12:51 user nova-compute[71364]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 (non-flash)
Apr 11 22:12:51 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae56e341-ae5d-4217-b362-f7112b89d56e]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:12:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIhQgOoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:52 user nova-compute[71364]: INFO nova.compute.manager [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Terminating instance
Apr 11 22:12:52 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-d2f15d88-1793-4f78-b193-4a4e4761005c req-56e00b30-25b4-4519-933a-b0b27609d11b service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received event network-vif-unplugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d2f15d88-1793-4f78-b193-4a4e4761005c req-56e00b30-25b4-4519-933a-b0b27609d11b service nova] Acquiring lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d2f15d88-1793-4f78-b193-4a4e4761005c req-56e00b30-25b4-4519-933a-b0b27609d11b service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d2f15d88-1793-4f78-b193-4a4e4761005c req-56e00b30-25b4-4519-933a-b0b27609d11b service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-d2f15d88-1793-4f78-b193-4a4e4761005c req-56e00b30-25b4-4519-933a-b0b27609d11b service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] No waiting events found dispatching network-vif-unplugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-d2f15d88-1793-4f78-b193-4a4e4761005c req-56e00b30-25b4-4519-933a-b0b27609d11b service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received event network-vif-unplugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26630346335336432', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630346335336432', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG nova.objects.instance [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lazy-loading 'flavor' on Instance uuid 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 22:12:52 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:12:52 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:12:52 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:12:52 user nova-compute[71364]:   <serial>328767e3-0dcc-4403-b8ef-223b9eab4900</serial>
Apr 11 22:12:52 user nova-compute[71364]: </disk>
Apr 11 22:12:52 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 22:12:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:53 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Instance destroyed successfully.
Apr 11 22:12:53 user nova-compute[71364]: DEBUG nova.objects.instance [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'resources' on Instance uuid ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1084422016',display_name='tempest-ServerActionsTestJSON-server-1084422016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1084422016',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:08:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-3j4bwdo9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:10:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "address": "fa:16:3e:40:36:11", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0b481ae-0b", "ovs_interfaceid": "b0b481ae-0b9d-4aac-ad21-f165acd47d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:36:11,bridge_name='br-int',has_traffic_filtering=True,id=b0b481ae-0b9d-4aac-ad21-f165acd47d15,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b481ae-0b') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_vif [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:36:11,bridge_name='br-int',has_traffic_filtering=True,id=b0b481ae-0b9d-4aac-ad21-f165acd47d15,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b481ae-0b') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0b481ae-0b, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:12:53 user nova-compute[71364]: INFO os_vif [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:36:11,bridge_name='br-int',has_traffic_filtering=True,id=b0b481ae-0b9d-4aac-ad21-f165acd47d15,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0b481ae-0b')
Apr 11 22:12:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BuEmJKle', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:12:53 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f467b96b-422a-4265-aa54-6ebe1e91ac2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:12:53 user nova-compute[71364]: No targets found.
Apr 11 22:12:53 user nova-compute[71364]: iSNS:
Apr 11 22:12:53 user nova-compute[71364]: No targets found.
Apr 11 22:12:53 user nova-compute[71364]: STATIC:
Apr 11 22:12:53 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:12:53 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:12:53 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:12:53 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900
Apr 11 22:12:53 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:12:53 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:12:53 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c
Apr 11 22:12:53 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:12:53 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:12:53 user nova-compute[71364]: FIRMWARE:
Apr 11 22:12:53 user nova-compute[71364]: No targets found.
Apr 11 22:12:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:12:53 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:12:53 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] No VIF found with MAC fa:16:3e:f6:18:9c, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60fa0a7-ecd0-4b1b-b3e3-4a6d0e16a95b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff34dfd-7851-4862-9d0f-9075e5ae2e19]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:12:53 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:12:53 user nova-compute[71364]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 (non-flash)
Apr 11 22:12:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:12:53 user nova-compute[71364]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c (non-flash)
Apr 11 22:12:53 user nova-compute[71364]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 (non-flash)
Apr 11 22:12:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bf44070a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c'): ({'sde'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Removing single pathed devices sde {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a7260e-b76b-460f-8746-f9df59086916]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f6eabc-bbed-46cf-86ec-f41b63b535ea]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flushing IO for device /dev/sde {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a703796-18e7-48ad-b2f9-60a70dd77580]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.439s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e84a30-b8c6-41eb-9582-36d4a92d1424]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] SCSI volumes sde have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2424b5-f906-423e-9566-201811d7e3ff]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba41ae5-4f3d-4ceb-a2b8-4f143a6f3337]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260]
Apr 11 22:12:53 user nova-compute[71364]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c, portal: 172.16.0.220,3260] successful.
Apr 11 22:12:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68c0a458-6bd5-45d6-b87b-1d992e32f75c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[335e0e1f-f15f-40ef-a5bf-de29e1d87dae]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] <== disconnect_volume: return (350ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:12:53 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Deleting instance files /opt/stack/data/nova/instances/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d_del
Apr 11 22:12:53 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Deletion of /opt/stack/data/nova/instances/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d_del complete
Apr 11 22:12:53 user nova-compute[71364]: INFO nova.compute.manager [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Took 1.51 seconds to destroy the instance on the hypervisor.
Apr 11 22:12:53 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:12:53 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:12:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-298801dc-6eb6-40fd-8353-31e10e33b42e req-1f4ab00c-3bc4-4790-8049-e930149bbc0b service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received event network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:12:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-298801dc-6eb6-40fd-8353-31e10e33b42e req-1f4ab00c-3bc4-4790-8049-e930149bbc0b service nova] Acquiring lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-298801dc-6eb6-40fd-8353-31e10e33b42e req-1f4ab00c-3bc4-4790-8049-e930149bbc0b service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-298801dc-6eb6-40fd-8353-31e10e33b42e req-1f4ab00c-3bc4-4790-8049-e930149bbc0b service nova] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-298801dc-6eb6-40fd-8353-31e10e33b42e req-1f4ab00c-3bc4-4790-8049-e930149bbc0b service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] No waiting events found dispatching network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:12:54 user nova-compute[71364]: WARNING nova.compute.manager [req-298801dc-6eb6-40fd-8353-31e10e33b42e req-1f4ab00c-3bc4-4790-8049-e930149bbc0b service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received unexpected event network-vif-plugged-b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance with vm_state active and task_state deleting.
Apr 11 22:12:54 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:12:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-02ea1acc-277b-488d-b3fe-cb476cdff2fa req-f4fdae65-1b20-4611-90c2-803f0cf29a85 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Received event network-vif-deleted-b0b481ae-0b9d-4aac-ad21-f165acd47d15 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:12:54 user nova-compute[71364]: INFO nova.compute.manager [req-02ea1acc-277b-488d-b3fe-cb476cdff2fa req-f4fdae65-1b20-4611-90c2-803f0cf29a85 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Neutron deleted interface b0b481ae-0b9d-4aac-ad21-f165acd47d15; detaching it from the instance and deleting it from the info cache
Apr 11 22:12:54 user nova-compute[71364]: DEBUG nova.network.neutron [req-02ea1acc-277b-488d-b3fe-cb476cdff2fa req-f4fdae65-1b20-4611-90c2-803f0cf29a85 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:12:54 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Took 0.87 seconds to deallocate network for instance.
Apr 11 22:12:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-02ea1acc-277b-488d-b3fe-cb476cdff2fa req-f4fdae65-1b20-4611-90c2-803f0cf29a85 service nova] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Detach interface failed, port_id=b0b481ae-0b9d-4aac-ad21-f165acd47d15, reason: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 22:12:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:55 user nova-compute[71364]: INFO nova.compute.manager [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Took 0.80 seconds to detach 1 volumes for instance.
Apr 11 22:12:55 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Deleting volume: 68c0a458-6bd5-45d6-b87b-1d992e32f75c {{(pid=71364) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 22:12:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:55 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:12:55 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:12:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:55 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Deleted allocations for instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d
Apr 11 22:12:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.708s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:56 user nova-compute[71364]: INFO nova.compute.manager [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Terminating instance
Apr 11 22:12:56 user nova-compute[71364]: DEBUG nova.compute.manager [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:12:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-58e2a249-d5bb-4b4e-a2d8-55ce50d02238 req-3aa6e8a0-ea27-40b8-af2a-459ec2d66b88 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-vif-unplugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:12:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-58e2a249-d5bb-4b4e-a2d8-55ce50d02238 req-3aa6e8a0-ea27-40b8-af2a-459ec2d66b88 service nova] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-58e2a249-d5bb-4b4e-a2d8-55ce50d02238 req-3aa6e8a0-ea27-40b8-af2a-459ec2d66b88 service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:56 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-58e2a249-d5bb-4b4e-a2d8-55ce50d02238 req-3aa6e8a0-ea27-40b8-af2a-459ec2d66b88 service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-58e2a249-d5bb-4b4e-a2d8-55ce50d02238 req-3aa6e8a0-ea27-40b8-af2a-459ec2d66b88 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] No waiting events found dispatching network-vif-unplugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:12:56 user nova-compute[71364]: DEBUG nova.compute.manager [req-58e2a249-d5bb-4b4e-a2d8-55ce50d02238 req-3aa6e8a0-ea27-40b8-af2a-459ec2d66b88 service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-vif-unplugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:57 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Instance destroyed successfully.
Apr 11 22:12:57 user nova-compute[71364]: DEBUG nova.objects.instance [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'resources' on Instance uuid c48d8944-6010-4d8d-9761-6ee0d7cd005b {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:57:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1124097939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1124097939',id=21,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53057a8fc17e400e8c26a7dec2c873f9',ramdisk_id='',reservation_id='r-vlygxs0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:00:58Z,user_data=None,user_id='10430313a8b44e6794ca88d30a83c69a',uuid=c48d8944-6010-4d8d-9761-6ee0d7cd005b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converting VIF {"id": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "address": "fa:16:3e:c4:30:2a", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e72bd4f-57", "ovs_interfaceid": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e72bd4f-57') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_vif [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e72bd4f-57') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e72bd4f-57, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:12:57 user nova-compute[71364]: INFO os_vif [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:30:2a,bridge_name='br-int',has_traffic_filtering=True,id=8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e72bd4f-57')
Apr 11 22:12:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RChlkXFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:12:57 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6882a1f3-33fe-4f22-98b0-3bcd43b444d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:12:57 user nova-compute[71364]: No targets found.
Apr 11 22:12:57 user nova-compute[71364]: iSNS:
Apr 11 22:12:57 user nova-compute[71364]: No targets found.
Apr 11 22:12:57 user nova-compute[71364]: STATIC:
Apr 11 22:12:57 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084
Apr 11 22:12:57 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:12:57 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:12:57 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900
Apr 11 22:12:57 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:12:57 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:12:57 user nova-compute[71364]: FIRMWARE:
Apr 11 22:12:57 user nova-compute[71364]: No targets found.
Apr 11 22:12:57 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:12:57 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:12:57 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad59f556-f0ee-424a-b7e6-b4745e191734]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac57ade9-ba64-493b-aeca-84405fac5911]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:12:57 user nova-compute[71364]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 (non-flash)
Apr 11 22:12:57 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 (non-flash)
Apr 11 22:12:57 user nova-compute[71364]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 (non-flash)
Apr 11 22:12:57 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff6ce830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084'): ({'sdc'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Removing single pathed devices sdc {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4b22a6-2364-483c-a73f-5fb09c367998]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5efdf34-6d36-4d6d-b3b9-fe5c862e1e42]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flushing IO for device /dev/sdc {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa745e3-8525-4b87-a054-e37ef45b3290]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae5f491-a1ec-4757-ae8e-e1351c3d397c]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce22d0a-6f83-4280-abb6-377a102e9387]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc9c69b-1cb2-4367-9d68-ca3dc8a4ed80]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084, portal: 172.16.0.220,3260]
Apr 11 22:12:57 user nova-compute[71364]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084, portal: 172.16.0.220,3260] successful.
Apr 11 22:12:57 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:34069ab4-9b63-44e2-98f1-f518605db084 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07ae59b-2ef8-4534-af5b-d483cb926cf4]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] <== disconnect_volume: return (291ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:12:57 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Deleting instance files /opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b_del
Apr 11 22:12:57 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Deletion of /opt/stack/data/nova/instances/c48d8944-6010-4d8d-9761-6ee0d7cd005b_del complete
Apr 11 22:12:57 user nova-compute[71364]: INFO nova.compute.manager [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 11 22:12:57 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:12:57 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:12:58 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:12:58 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Took 0.48 seconds to deallocate network for instance.
Apr 11 22:12:58 user nova-compute[71364]: DEBUG nova.compute.manager [req-3cc9465f-4dab-416e-8ed5-b182e81b0445 req-1e87c38c-87d8-4ae2-889f-08a95910074f service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-vif-deleted-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:12:58 user nova-compute[71364]: INFO nova.compute.manager [req-3cc9465f-4dab-416e-8ed5-b182e81b0445 req-1e87c38c-87d8-4ae2-889f-08a95910074f service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Neutron deleted interface 8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d; detaching it from the instance and deleting it from the info cache
Apr 11 22:12:58 user nova-compute[71364]: DEBUG nova.network.neutron [req-3cc9465f-4dab-416e-8ed5-b182e81b0445 req-1e87c38c-87d8-4ae2-889f-08a95910074f service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:12:58 user nova-compute[71364]: DEBUG nova.compute.manager [req-3cc9465f-4dab-416e-8ed5-b182e81b0445 req-1e87c38c-87d8-4ae2-889f-08a95910074f service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Detach interface failed, port_id=8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d, reason: Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b could not be found. {{(pid=71364) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 11 22:12:58 user nova-compute[71364]: DEBUG nova.compute.manager [req-356192a2-5c6c-43d7-83b9-fdcb3d7dfcd3 req-dd99af67-8b68-40dd-9ef7-3e0ed9cab24c service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:12:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-356192a2-5c6c-43d7-83b9-fdcb3d7dfcd3 req-dd99af67-8b68-40dd-9ef7-3e0ed9cab24c service nova] Acquiring lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-356192a2-5c6c-43d7-83b9-fdcb3d7dfcd3 req-dd99af67-8b68-40dd-9ef7-3e0ed9cab24c service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-356192a2-5c6c-43d7-83b9-fdcb3d7dfcd3 req-dd99af67-8b68-40dd-9ef7-3e0ed9cab24c service nova] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:58 user nova-compute[71364]: DEBUG nova.compute.manager [req-356192a2-5c6c-43d7-83b9-fdcb3d7dfcd3 req-dd99af67-8b68-40dd-9ef7-3e0ed9cab24c service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] No waiting events found dispatching network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:12:58 user nova-compute[71364]: WARNING nova.compute.manager [req-356192a2-5c6c-43d7-83b9-fdcb3d7dfcd3 req-dd99af67-8b68-40dd-9ef7-3e0ed9cab24c service nova] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Received unexpected event network-vif-plugged-8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance with vm_state active and task_state deleting.
Apr 11 22:12:59 user nova-compute[71364]: INFO nova.compute.manager [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Took 0.74 seconds to detach 1 volumes for instance.
Apr 11 22:12:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:12:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:12:59 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:12:59 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:12:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:59 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Deleted allocations for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b
Apr 11 22:12:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "c48d8944-6010-4d8d-9761-6ee0d7cd005b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.749s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:12:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:01 user nova-compute[71364]: INFO nova.compute.manager [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Detaching volume 328767e3-0dcc-4403-b8ef-223b9eab4900
Apr 11 22:13:01 user nova-compute[71364]: INFO nova.virt.block_device [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Attempting to driver detach volume 328767e3-0dcc-4403-b8ef-223b9eab4900 from mountpoint /dev/vdb
Apr 11 22:13:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Attempting to detach device vdb from instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:13:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:13:01 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:13:01 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:13:01 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:13:01 user nova-compute[71364]:   <serial>328767e3-0dcc-4403-b8ef-223b9eab4900</serial>
Apr 11 22:13:01 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:13:01 user nova-compute[71364]: </disk>
Apr 11 22:13:01 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:13:01 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Successfully detached device vdb from instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef from the persistent domain config.
Apr 11 22:13:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:13:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:13:01 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:13:01 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:13:01 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:13:01 user nova-compute[71364]:   <serial>328767e3-0dcc-4403-b8ef-223b9eab4900</serial>
Apr 11 22:13:01 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:13:01 user nova-compute[71364]: </disk>
Apr 11 22:13:01 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:13:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681251182.251607, 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:13:02 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Successfully detached device vdb from instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef from the live domain config.
Apr 11 22:13:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIhQgOoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:13:02 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ca71e1-bd46-472a-992a-23224e0c5d6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:13:02 user nova-compute[71364]: No targets found.
Apr 11 22:13:02 user nova-compute[71364]: iSNS:
Apr 11 22:13:02 user nova-compute[71364]: No targets found.
Apr 11 22:13:02 user nova-compute[71364]: STATIC:
Apr 11 22:13:02 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900
Apr 11 22:13:02 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:13:02 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:13:02 user nova-compute[71364]: FIRMWARE:
Apr 11 22:13:02 user nova-compute[71364]: No targets found.
Apr 11 22:13:02 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:13:02 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:13:02 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[411aed99-d130-4174-9b2c-aca39a3e094b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[42404666-4dac-4b5f-b111-e29a6325f3e9]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 (non-flash)
Apr 11 22:13:02 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 (non-flash)
Apr 11 22:13:02 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacd8bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6112d5e-52f0-43d3-9d4b-77184e68e9aa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[351e9bd0-11b9-411d-a194-259ba6d6550c]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a61916-8c55-45bb-969f-32dcb92797d8]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f130073-4d4e-4f29-bde7-81bf301badb8]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ace6bca-a647-46fc-b242-604f00070c3d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff7f5be-f457-4c69-b716-5be0e6c62552]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900, portal: 172.16.0.220,3260]
Apr 11 22:13:02 user nova-compute[71364]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900, portal: 172.16.0.220,3260] successful.
Apr 11 22:13:02 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb5bdf7-2a59-4afb-9068-56b57c3ceff4]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] <== disconnect_volume: return (297ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:13:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:13:03 user nova-compute[71364]: DEBUG nova.objects.instance [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lazy-loading 'flavor' on Instance uuid 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:13:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.609s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.499s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:03 user nova-compute[71364]: INFO nova.compute.manager [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Terminating instance
Apr 11 22:13:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:13:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-5fa2d206-d584-4b26-a22c-08a82a46afad req-da7cf40e-e5f0-4719-9280-9882ad8b00cb service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Received event network-vif-unplugged-6c0af63c-303d-44dd-acb5-0b939a80a8f3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:13:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5fa2d206-d584-4b26-a22c-08a82a46afad req-da7cf40e-e5f0-4719-9280-9882ad8b00cb service nova] Acquiring lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5fa2d206-d584-4b26-a22c-08a82a46afad req-da7cf40e-e5f0-4719-9280-9882ad8b00cb service nova] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5fa2d206-d584-4b26-a22c-08a82a46afad req-da7cf40e-e5f0-4719-9280-9882ad8b00cb service nova] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-5fa2d206-d584-4b26-a22c-08a82a46afad req-da7cf40e-e5f0-4719-9280-9882ad8b00cb service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] No waiting events found dispatching network-vif-unplugged-6c0af63c-303d-44dd-acb5-0b939a80a8f3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:13:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-5fa2d206-d584-4b26-a22c-08a82a46afad req-da7cf40e-e5f0-4719-9280-9882ad8b00cb service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Received event network-vif-unplugged-6c0af63c-303d-44dd-acb5-0b939a80a8f3 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:13:04 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Instance destroyed successfully.
Apr 11 22:13:04 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lazy-loading 'resources' on Instance uuid 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-845148370',display_name='tempest-VolumesSnapshotTestJSON-instance-845148370',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-845148370',id=36,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:11:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b2e33082edb407983882075d3237264',ramdisk_id='',reservation_id='r-tmryv04l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-279092346',owner_user_name='tempest-VolumesSnapshotTestJSON-279092346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:11:03Z,user_data=None,user_id='d28c7ae9f6dc4f06a7202bcab3afb0ac',uuid=8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "address": "fa:16:3e:f6:18:9c", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0af63c-30", "ovs_interfaceid": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Converting VIF {"id": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "address": "fa:16:3e:f6:18:9c", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c0af63c-30", "ovs_interfaceid": "6c0af63c-303d-44dd-acb5-0b939a80a8f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=6c0af63c-303d-44dd-acb5-0b939a80a8f3,network=Network(65f8b365-752d-40d7-aa38-7980a188a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c0af63c-30') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG os_vif [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=6c0af63c-303d-44dd-acb5-0b939a80a8f3,network=Network(65f8b365-752d-40d7-aa38-7980a188a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c0af63c-30') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c0af63c-30, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:13:04 user nova-compute[71364]: INFO os_vif [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:18:9c,bridge_name='br-int',has_traffic_filtering=True,id=6c0af63c-303d-44dd-acb5-0b939a80a8f3,network=Network(65f8b365-752d-40d7-aa38-7980a188a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c0af63c-30')
Apr 11 22:13:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:328767e3-0dcc-4403-b8ef-223b9eab4900', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sIhQgOoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:13:04 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:13:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[f6a077c5-8f8e-48f6-abd9-dd6dd63baec1]: Unexpected error while running command.
Apr 11 22:13:04 user nova-compute[71364]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 22:13:04 user nova-compute[71364]: Exit code: 21
Apr 11 22:13:04 user nova-compute[71364]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 22:13:04 user nova-compute[71364]: Stderr: '' {{(pid=81576) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 11 22:13:04 user nova-compute[71364]: Traceback (most recent call last):
Apr 11 22:13:04 user nova-compute[71364]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 11 22:13:04 user nova-compute[71364]:     ret = func(*f_args, **f_kwargs)
Apr 11 22:13:04 user nova-compute[71364]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 11 22:13:04 user nova-compute[71364]:     return func(*args, **kwargs)
Apr 11 22:13:04 user nova-compute[71364]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 11 22:13:04 user nova-compute[71364]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 11 22:13:04 user nova-compute[71364]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 11 22:13:04 user nova-compute[71364]:     return putils.execute(on_execute=on_execute,
Apr 11 22:13:04 user nova-compute[71364]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 11 22:13:04 user nova-compute[71364]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 11 22:13:04 user nova-compute[71364]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 11 22:13:04 user nova-compute[71364]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 22:13:04 user nova-compute[71364]: Exit code: 21
Apr 11 22:13:04 user nova-compute[71364]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 22:13:04 user nova-compute[71364]: Stderr: ''
Apr 11 22:13:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a077c5-8f8e-48f6-abd9-dd6dd63baec1]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 11 22:13:04 user nova-compute[71364]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 22:13:04 user nova-compute[71364]: Exit code: 21
Apr 11 22:13:04 user nova-compute[71364]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 22:13:04 user nova-compute[71364]: Stderr: ''
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 11 22:13:04 user nova-compute[71364]: ERROR os_brick.initiator.connectors.iscsi 
Apr 11 22:13:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=71364) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] <== disconnect_volume: return (66ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:13:04 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Deleting instance files /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef_del
Apr 11 22:13:04 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Deletion of /opt/stack/data/nova/instances/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef_del complete
Apr 11 22:13:04 user nova-compute[71364]: INFO nova.compute.manager [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 11 22:13:04 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:13:04 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Took 0.52 seconds to deallocate network for instance.
Apr 11 22:13:04 user nova-compute[71364]: DEBUG nova.compute.manager [req-cedf3593-fcc6-4dfc-86bf-a5512d9d5dd2 req-e3696c6f-424d-48ed-97ab-e185e9aa2226 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Received event network-vif-deleted-6c0af63c-303d-44dd-acb5-0b939a80a8f3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:13:04 user nova-compute[71364]: WARNING nova.volume.cinder [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Attachment cc20a1e5-4ade-4a75-a846-91bfaf6e1639 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = cc20a1e5-4ade-4a75-a846-91bfaf6e1639. (HTTP 404) (Request-ID: req-15ed6f84-ed1a-4410-82c7-cae68da2de1c)
Apr 11 22:13:04 user nova-compute[71364]: INFO nova.compute.manager [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Took 0.02 seconds to detach 1 volumes for instance.
Apr 11 22:13:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:13:04 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:13:05 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Deleted allocations for instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.937s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-5c528d4d-c9db-42a8-8a93-07fd6442bc43 req-1b497d38-d519-4fa4-9aa3-96c74ba02553 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Received event network-vif-plugged-6c0af63c-303d-44dd-acb5-0b939a80a8f3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5c528d4d-c9db-42a8-8a93-07fd6442bc43 req-1b497d38-d519-4fa4-9aa3-96c74ba02553 service nova] Acquiring lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5c528d4d-c9db-42a8-8a93-07fd6442bc43 req-1b497d38-d519-4fa4-9aa3-96c74ba02553 service nova] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5c528d4d-c9db-42a8-8a93-07fd6442bc43 req-1b497d38-d519-4fa4-9aa3-96c74ba02553 service nova] Lock "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-5c528d4d-c9db-42a8-8a93-07fd6442bc43 req-1b497d38-d519-4fa4-9aa3-96c74ba02553 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] No waiting events found dispatching network-vif-plugged-6c0af63c-303d-44dd-acb5-0b939a80a8f3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:13:05 user nova-compute[71364]: WARNING nova.compute.manager [req-5c528d4d-c9db-42a8-8a93-07fd6442bc43 req-1b497d38-d519-4fa4-9aa3-96c74ba02553 service nova] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Received unexpected event network-vif-plugged-6c0af63c-303d-44dd-acb5-0b939a80a8f3 for instance with vm_state deleted and task_state None.
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:06 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:13:06 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:13:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8443MB free_disk=26.156871795654297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:13:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:13:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:13:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3331e482-bd81-47da-9e66-eade6dd2edcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:13:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:13:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:13:06 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:13:06 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:13:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:13:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:08 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251173.1357968, ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:13:08 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] VM Stopped (Lifecycle Event)
Apr 11 22:13:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-222e2052-2b27-4ddc-b6eb-c621e9d933bc None None] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:13:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:13:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:13:11 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:13:11 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:13:11 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Didn't find any instances for network info cache update. {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 22:13:11 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:13:11 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:13:11 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:13:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:13:12 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251177.4487495, c48d8944-6010-4d8d-9761-6ee0d7cd005b => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:13:12 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] VM Stopped (Lifecycle Event)
Apr 11 22:13:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c26d2572-b132-49c5-9377-b250581f7617 None None] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:13:13 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:13:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:13:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:13:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:13:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:13:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:13:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:19 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251184.077714, 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:13:19 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] VM Stopped (Lifecycle Event)
Apr 11 22:13:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-cbeaf16d-23da-462d-9d80-923186e6a6fd None None] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:13:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:13:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:13:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:13:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:13:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:13:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:13:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:13:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:13:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:13:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:42 user nova-compute[71364]: INFO nova.compute.manager [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Terminating instance
Apr 11 22:13:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-d338437b-f6ac-4dca-84b6-4976f6d18098 req-b726e327-d3ad-478d-9f31-1cc2fb648b06 service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Received event network-vif-unplugged-184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d338437b-f6ac-4dca-84b6-4976f6d18098 req-b726e327-d3ad-478d-9f31-1cc2fb648b06 service nova] Acquiring lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d338437b-f6ac-4dca-84b6-4976f6d18098 req-b726e327-d3ad-478d-9f31-1cc2fb648b06 service nova] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d338437b-f6ac-4dca-84b6-4976f6d18098 req-b726e327-d3ad-478d-9f31-1cc2fb648b06 service nova] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-d338437b-f6ac-4dca-84b6-4976f6d18098 req-b726e327-d3ad-478d-9f31-1cc2fb648b06 service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] No waiting events found dispatching network-vif-unplugged-184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:13:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-d338437b-f6ac-4dca-84b6-4976f6d18098 req-b726e327-d3ad-478d-9f31-1cc2fb648b06 service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Received event network-vif-unplugged-184fffcb-758c-4ac6-afbd-b3d27a38f374 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:13:43 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Instance destroyed successfully.
Apr 11 22:13:43 user nova-compute[71364]: DEBUG nova.objects.instance [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'resources' on Instance uuid 9e44ad56-d695-409c-9d35-3d3dec2c3a89 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1841742325',display_name='tempest-ServerActionsTestJSON-server-1841742325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1841742325',id=31,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw==',key_name='tempest-keypair-132763272',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:04:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9fff7d112a94e7da6bf166a6f628fed',ramdisk_id='',reservation_id='r-7bmafrhj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-434853204',owner_user_name='tempest-ServerActionsTestJSON-434853204-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:04:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='939785ef89cb491aae3df4f411b2543d',uuid=9e44ad56-d695-409c-9d35-3d3dec2c3a89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "address": "fa:16:3e:89:4e:e1", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184fffcb-75", "ovs_interfaceid": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converting VIF {"id": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "address": "fa:16:3e:89:4e:e1", "network": {"id": "164ecdd3-8d2c-47ea-8886-e35d1e88f045", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1222517197-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9fff7d112a94e7da6bf166a6f628fed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap184fffcb-75", "ovs_interfaceid": "184fffcb-758c-4ac6-afbd-b3d27a38f374", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:4e:e1,bridge_name='br-int',has_traffic_filtering=True,id=184fffcb-758c-4ac6-afbd-b3d27a38f374,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184fffcb-75') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG os_vif [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:4e:e1,bridge_name='br-int',has_traffic_filtering=True,id=184fffcb-758c-4ac6-afbd-b3d27a38f374,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184fffcb-75') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap184fffcb-75, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:43 user nova-compute[71364]: INFO os_vif [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:4e:e1,bridge_name='br-int',has_traffic_filtering=True,id=184fffcb-758c-4ac6-afbd-b3d27a38f374,network=Network(164ecdd3-8d2c-47ea-8886-e35d1e88f045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap184fffcb-75')
Apr 11 22:13:43 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Deleting instance files /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89_del
Apr 11 22:13:43 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Deletion of /opt/stack/data/nova/instances/9e44ad56-d695-409c-9d35-3d3dec2c3a89_del complete
Apr 11 22:13:43 user nova-compute[71364]: INFO nova.compute.manager [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 11 22:13:43 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:13:43 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Took 0.45 seconds to deallocate network for instance.
Apr 11 22:13:43 user nova-compute[71364]: DEBUG nova.compute.manager [req-129ced99-7556-48fe-8514-a7a3031960b0 req-f9e8eb5b-2da3-45b0-8408-ebf1658881b6 service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Received event network-vif-deleted-184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:13:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:43 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Deleted allocations for instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89
Apr 11 22:13:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.419s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-09230015-683f-4f41-826a-adfd5261eecb req-43869870-3e72-485f-b3eb-a3457bdc659d service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Received event network-vif-plugged-184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:13:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-09230015-683f-4f41-826a-adfd5261eecb req-43869870-3e72-485f-b3eb-a3457bdc659d service nova] Acquiring lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-09230015-683f-4f41-826a-adfd5261eecb req-43869870-3e72-485f-b3eb-a3457bdc659d service nova] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-09230015-683f-4f41-826a-adfd5261eecb req-43869870-3e72-485f-b3eb-a3457bdc659d service nova] Lock "9e44ad56-d695-409c-9d35-3d3dec2c3a89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-09230015-683f-4f41-826a-adfd5261eecb req-43869870-3e72-485f-b3eb-a3457bdc659d service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] No waiting events found dispatching network-vif-plugged-184fffcb-758c-4ac6-afbd-b3d27a38f374 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:13:44 user nova-compute[71364]: WARNING nova.compute.manager [req-09230015-683f-4f41-826a-adfd5261eecb req-43869870-3e72-485f-b3eb-a3457bdc659d service nova] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Received unexpected event network-vif-plugged-184fffcb-758c-4ac6-afbd-b3d27a38f374 for instance with vm_state deleted and task_state None.
Apr 11 22:13:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "29e6c78a-dee0-4d28-86cd-debad15718d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:47 user nova-compute[71364]: INFO nova.compute.manager [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Terminating instance
Apr 11 22:13:47 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-7325892f-d83c-436c-a4c3-71e8bc0664e6 req-b176177d-84a0-45e3-a452-91545130646d service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received event network-vif-unplugged-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7325892f-d83c-436c-a4c3-71e8bc0664e6 req-b176177d-84a0-45e3-a452-91545130646d service nova] Acquiring lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7325892f-d83c-436c-a4c3-71e8bc0664e6 req-b176177d-84a0-45e3-a452-91545130646d service nova] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7325892f-d83c-436c-a4c3-71e8bc0664e6 req-b176177d-84a0-45e3-a452-91545130646d service nova] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-7325892f-d83c-436c-a4c3-71e8bc0664e6 req-b176177d-84a0-45e3-a452-91545130646d service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] No waiting events found dispatching network-vif-unplugged-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:13:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-7325892f-d83c-436c-a4c3-71e8bc0664e6 req-b176177d-84a0-45e3-a452-91545130646d service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received event network-vif-unplugged-2e074aaa-933c-4085-ad92-4699f1ac3975 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:48 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Instance destroyed successfully.
Apr 11 22:13:48 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'resources' on Instance uuid 29e6c78a-dee0-4d28-86cd-debad15718d4 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T21:54:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1886871260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1886871260',id=15,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T21:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53057a8fc17e400e8c26a7dec2c873f9',ramdisk_id='',reservation_id='r-6bs8od9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T21:56:09Z,user_data=None,user_id='10430313a8b44e6794ca88d30a83c69a',uuid=29e6c78a-dee0-4d28-86cd-debad15718d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e074aaa-933c-4085-ad92-4699f1ac3975", "address": "fa:16:3e:8f:33:19", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e074aaa-93", "ovs_interfaceid": "2e074aaa-933c-4085-ad92-4699f1ac3975", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converting VIF {"id": "2e074aaa-933c-4085-ad92-4699f1ac3975", "address": "fa:16:3e:8f:33:19", "network": {"id": "a5775e8b-9458-472b-81e3-a07b5617cc13", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-463190627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53057a8fc17e400e8c26a7dec2c873f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e074aaa-93", "ovs_interfaceid": "2e074aaa-933c-4085-ad92-4699f1ac3975", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:33:19,bridge_name='br-int',has_traffic_filtering=True,id=2e074aaa-933c-4085-ad92-4699f1ac3975,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e074aaa-93') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG os_vif [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:33:19,bridge_name='br-int',has_traffic_filtering=True,id=2e074aaa-933c-4085-ad92-4699f1ac3975,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e074aaa-93') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e074aaa-93, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:13:48 user nova-compute[71364]: INFO os_vif [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:33:19,bridge_name='br-int',has_traffic_filtering=True,id=2e074aaa-933c-4085-ad92-4699f1ac3975,network=Network(a5775e8b-9458-472b-81e3-a07b5617cc13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e074aaa-93')
Apr 11 22:13:48 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Deleting instance files /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4_del
Apr 11 22:13:48 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Deletion of /opt/stack/data/nova/instances/29e6c78a-dee0-4d28-86cd-debad15718d4_del complete
Apr 11 22:13:48 user nova-compute[71364]: INFO nova.compute.manager [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 11 22:13:48 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:13:49 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Took 1.13 seconds to deallocate network for instance.
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.131s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:49 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Deleted allocations for instance 29e6c78a-dee0-4d28-86cd-debad15718d4
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.308s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received event network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Acquiring lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] No waiting events found dispatching network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:13:49 user nova-compute[71364]: WARNING nova.compute.manager [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received unexpected event network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 for instance with vm_state deleted and task_state None.
Apr 11 22:13:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received event network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Acquiring lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] No waiting events found dispatching network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:13:49 user nova-compute[71364]: WARNING nova.compute.manager [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received unexpected event network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 for instance with vm_state deleted and task_state None.
Apr 11 22:13:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received event network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Acquiring lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] No waiting events found dispatching network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:13:49 user nova-compute[71364]: WARNING nova.compute.manager [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received unexpected event network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 for instance with vm_state deleted and task_state None.
Apr 11 22:13:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received event network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Acquiring lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Lock "29e6c78a-dee0-4d28-86cd-debad15718d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] No waiting events found dispatching network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:13:49 user nova-compute[71364]: WARNING nova.compute.manager [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received unexpected event network-vif-plugged-2e074aaa-933c-4085-ad92-4699f1ac3975 for instance with vm_state deleted and task_state None.
Apr 11 22:13:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Received event network-vif-deleted-2e074aaa-933c-4085-ad92-4699f1ac3975 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:13:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251223.116925, 9e44ad56-d695-409c-9d35-3d3dec2c3a89 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:13:58 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] VM Stopped (Lifecycle Event)
Apr 11 22:13:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d1c1feb2-3abe-4958-ac81-2f31777ee77c None None] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "99256cf6-676b-4e28-9c09-288d761020e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "99256cf6-676b-4e28-9c09-288d761020e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:13:58 user nova-compute[71364]: INFO nova.compute.claims [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Claim successful on node user
Apr 11 22:13:58 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:13:58 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:13:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG nova.policy [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd28c7ae9f6dc4f06a7202bcab3afb0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2e33082edb407983882075d3237264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:13:58 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Creating image(s)
Apr 11 22:13:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "/opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "/opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "/opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:58 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.147s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk 1073741824" returned: 0 in 0.050s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG nova.network.neutron [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Successfully created port: 18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Cannot resize image /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG nova.objects.instance [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lazy-loading 'migration_context' on Instance uuid 99256cf6-676b-4e28-9c09-288d761020e8 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Ensure instance console log exists: /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG nova.network.neutron [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Successfully updated port: 18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "refresh_cache-99256cf6-676b-4e28-9c09-288d761020e8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquired lock "refresh_cache-99256cf6-676b-4e28-9c09-288d761020e8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG nova.network.neutron [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-a2a15232-2c7c-4db6-8413-75347ca057da req-b3df554f-24b0-476c-b7f5-336e6cb8d32f service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received event network-changed-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-a2a15232-2c7c-4db6-8413-75347ca057da req-b3df554f-24b0-476c-b7f5-336e6cb8d32f service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Refreshing instance network info cache due to event network-changed-18a9e3be-a4c2-4d8f-838b-d07722cd7647. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:13:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a2a15232-2c7c-4db6-8413-75347ca057da req-b3df554f-24b0-476c-b7f5-336e6cb8d32f service nova] Acquiring lock "refresh_cache-99256cf6-676b-4e28-9c09-288d761020e8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Updating instance_info_cache with network_info: [{"id": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "address": "fa:16:3e:6c:b4:63", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a9e3be-a4", "ovs_interfaceid": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Releasing lock "refresh_cache-99256cf6-676b-4e28-9c09-288d761020e8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Instance network_info: |[{"id": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "address": "fa:16:3e:6c:b4:63", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a9e3be-a4", "ovs_interfaceid": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a2a15232-2c7c-4db6-8413-75347ca057da req-b3df554f-24b0-476c-b7f5-336e6cb8d32f service nova] Acquired lock "refresh_cache-99256cf6-676b-4e28-9c09-288d761020e8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.network.neutron [req-a2a15232-2c7c-4db6-8413-75347ca057da req-b3df554f-24b0-476c-b7f5-336e6cb8d32f service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Refreshing network info cache for port 18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Start _get_guest_xml network_info=[{"id": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "address": "fa:16:3e:6c:b4:63", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a9e3be-a4", "ovs_interfaceid": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:14:00 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:14:00 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1497432760',display_name='tempest-VolumesSnapshotTestJSON-instance-1497432760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1497432760',id=38,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b2e33082edb407983882075d3237264',ramdisk_id='',reservation_id='r-9axm532w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-279092346',owner_user_name='tempest-VolumesSnapshotTestJSON-279092346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:13:59Z,user_data=None,user_id='d28c7ae9f6dc4f06a7202bcab3afb0ac',uuid=99256cf6-676b-4e28-9c09-288d761020e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "address": "fa:16:3e:6c:b4:63", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a9e3be-a4", "ovs_interfaceid": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Converting VIF {"id": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "address": "fa:16:3e:6c:b4:63", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a9e3be-a4", "ovs_interfaceid": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b4:63,bridge_name='br-int',has_traffic_filtering=True,id=18a9e3be-a4c2-4d8f-838b-d07722cd7647,network=Network(65f8b365-752d-40d7-aa38-7980a188a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a9e3be-a4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.objects.instance [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lazy-loading 'pci_devices' on Instance uuid 99256cf6-676b-4e28-9c09-288d761020e8 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:14:00 user nova-compute[71364]:   <uuid>99256cf6-676b-4e28-9c09-288d761020e8</uuid>
Apr 11 22:14:00 user nova-compute[71364]:   <name>instance-00000026</name>
Apr 11 22:14:00 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:14:00 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:14:00 user nova-compute[71364]:   <metadata>
Apr 11 22:14:00 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:14:00 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:14:00 user nova-compute[71364]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1497432760</nova:name>
Apr 11 22:14:00 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:14:00</nova:creationTime>
Apr 11 22:14:00 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:14:00 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:14:00 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:14:00 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:14:00 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:14:00 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:14:00 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:14:00 user nova-compute[71364]:       <nova:owner>
Apr 11 22:14:00 user nova-compute[71364]:         <nova:user uuid="d28c7ae9f6dc4f06a7202bcab3afb0ac">tempest-VolumesSnapshotTestJSON-279092346-project-member</nova:user>
Apr 11 22:14:00 user nova-compute[71364]:         <nova:project uuid="4b2e33082edb407983882075d3237264">tempest-VolumesSnapshotTestJSON-279092346</nova:project>
Apr 11 22:14:00 user nova-compute[71364]:       </nova:owner>
Apr 11 22:14:00 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:14:00 user nova-compute[71364]:       <nova:ports>
Apr 11 22:14:00 user nova-compute[71364]:         <nova:port uuid="18a9e3be-a4c2-4d8f-838b-d07722cd7647">
Apr 11 22:14:00 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 22:14:00 user nova-compute[71364]:         </nova:port>
Apr 11 22:14:00 user nova-compute[71364]:       </nova:ports>
Apr 11 22:14:00 user nova-compute[71364]:     </nova:instance>
Apr 11 22:14:00 user nova-compute[71364]:   </metadata>
Apr 11 22:14:00 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:14:00 user nova-compute[71364]:     <system>
Apr 11 22:14:00 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:14:00 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:14:00 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:14:00 user nova-compute[71364]:       <entry name="serial">99256cf6-676b-4e28-9c09-288d761020e8</entry>
Apr 11 22:14:00 user nova-compute[71364]:       <entry name="uuid">99256cf6-676b-4e28-9c09-288d761020e8</entry>
Apr 11 22:14:00 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:14:00 user nova-compute[71364]:     </system>
Apr 11 22:14:00 user nova-compute[71364]:   </sysinfo>
Apr 11 22:14:00 user nova-compute[71364]:   <os>
Apr 11 22:14:00 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:14:00 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:14:00 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:14:00 user nova-compute[71364]:   </os>
Apr 11 22:14:00 user nova-compute[71364]:   <features>
Apr 11 22:14:00 user nova-compute[71364]:     <acpi/>
Apr 11 22:14:00 user nova-compute[71364]:     <apic/>
Apr 11 22:14:00 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:14:00 user nova-compute[71364]:   </features>
Apr 11 22:14:00 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:14:00 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:14:00 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:14:00 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:14:00 user nova-compute[71364]:   </clock>
Apr 11 22:14:00 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:14:00 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:14:00 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:14:00 user nova-compute[71364]:   </cpu>
Apr 11 22:14:00 user nova-compute[71364]:   <devices>
Apr 11 22:14:00 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:14:00 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:14:00 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk"/>
Apr 11 22:14:00 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:14:00 user nova-compute[71364]:     </disk>
Apr 11 22:14:00 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:14:00 user nova-compute[71364]:       <mac address="fa:16:3e:6c:b4:63"/>
Apr 11 22:14:00 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:14:00 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:14:00 user nova-compute[71364]:       <target dev="tap18a9e3be-a4"/>
Apr 11 22:14:00 user nova-compute[71364]:     </interface>
Apr 11 22:14:00 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:14:00 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/console.log" append="off"/>
Apr 11 22:14:00 user nova-compute[71364]:     </serial>
Apr 11 22:14:00 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:14:00 user nova-compute[71364]:     <video>
Apr 11 22:14:00 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:14:00 user nova-compute[71364]:     </video>
Apr 11 22:14:00 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:14:00 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:14:00 user nova-compute[71364]:     </rng>
Apr 11 22:14:00 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:14:00 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:14:00 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:14:00 user nova-compute[71364]:     </memballoon>
Apr 11 22:14:00 user nova-compute[71364]:   </devices>
Apr 11 22:14:00 user nova-compute[71364]: </domain>
Apr 11 22:14:00 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1497432760',display_name='tempest-VolumesSnapshotTestJSON-instance-1497432760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1497432760',id=38,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b2e33082edb407983882075d3237264',ramdisk_id='',reservation_id='r-9axm532w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-279092346',owner_user_name='tempest-VolumesSnapshotTestJSON-279092346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:13:59Z,user_data=None,user_id='d28c7ae9f6dc4f06a7202bcab3afb0ac',uuid=99256cf6-676b-4e28-9c09-288d761020e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "address": "fa:16:3e:6c:b4:63", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a9e3be-a4", "ovs_interfaceid": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Converting VIF {"id": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "address": "fa:16:3e:6c:b4:63", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a9e3be-a4", "ovs_interfaceid": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b4:63,bridge_name='br-int',has_traffic_filtering=True,id=18a9e3be-a4c2-4d8f-838b-d07722cd7647,network=Network(65f8b365-752d-40d7-aa38-7980a188a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a9e3be-a4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG os_vif [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b4:63,bridge_name='br-int',has_traffic_filtering=True,id=18a9e3be-a4c2-4d8f-838b-d07722cd7647,network=Network(65f8b365-752d-40d7-aa38-7980a188a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a9e3be-a4') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18a9e3be-a4, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18a9e3be-a4, col_values=(('external_ids', {'iface-id': '18a9e3be-a4c2-4d8f-838b-d07722cd7647', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:b4:63', 'vm-uuid': '99256cf6-676b-4e28-9c09-288d761020e8'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:00 user nova-compute[71364]: INFO os_vif [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b4:63,bridge_name='br-int',has_traffic_filtering=True,id=18a9e3be-a4c2-4d8f-838b-d07722cd7647,network=Network(65f8b365-752d-40d7-aa38-7980a188a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a9e3be-a4')
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] No VIF found with MAC fa:16:3e:6c:b4:63, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.network.neutron [req-a2a15232-2c7c-4db6-8413-75347ca057da req-b3df554f-24b0-476c-b7f5-336e6cb8d32f service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Updated VIF entry in instance network info cache for port 18a9e3be-a4c2-4d8f-838b-d07722cd7647. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG nova.network.neutron [req-a2a15232-2c7c-4db6-8413-75347ca057da req-b3df554f-24b0-476c-b7f5-336e6cb8d32f service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Updating instance_info_cache with network_info: [{"id": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "address": "fa:16:3e:6c:b4:63", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a9e3be-a4", "ovs_interfaceid": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:14:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a2a15232-2c7c-4db6-8413-75347ca057da req-b3df554f-24b0-476c-b7f5-336e6cb8d32f service nova] Releasing lock "refresh_cache-99256cf6-676b-4e28-9c09-288d761020e8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:14:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-431f29ed-f661-48ef-8724-760105519d72 req-6f4487a8-754b-493d-9809-5d6c5fe1d930 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received event network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:14:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-431f29ed-f661-48ef-8724-760105519d72 req-6f4487a8-754b-493d-9809-5d6c5fe1d930 service nova] Acquiring lock "99256cf6-676b-4e28-9c09-288d761020e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:14:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-431f29ed-f661-48ef-8724-760105519d72 req-6f4487a8-754b-493d-9809-5d6c5fe1d930 service nova] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:14:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-431f29ed-f661-48ef-8724-760105519d72 req-6f4487a8-754b-493d-9809-5d6c5fe1d930 service nova] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:14:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-431f29ed-f661-48ef-8724-760105519d72 req-6f4487a8-754b-493d-9809-5d6c5fe1d930 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] No waiting events found dispatching network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:14:01 user nova-compute[71364]: WARNING nova.compute.manager [req-431f29ed-f661-48ef-8724-760105519d72 req-6f4487a8-754b-493d-9809-5d6c5fe1d930 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received unexpected event network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance with vm_state building and task_state spawning.
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251228.1535072, 29e6c78a-dee0-4d28-86cd-debad15718d4 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:14:03 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] VM Stopped (Lifecycle Event)
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-9196a034-d277-49d4-96b5-e51dd1d3af0f None None] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251243.9256053, 99256cf6-676b-4e28-9c09-288d761020e8 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:14:03 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] VM Resumed (Lifecycle Event)
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:14:03 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Instance spawned successfully.
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:14:03 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251243.9274123, 99256cf6-676b-4e28-9c09-288d761020e8 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:14:03 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] VM Started (Lifecycle Event)
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:14:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:14:04 user nova-compute[71364]: DEBUG nova.compute.manager [req-00723ace-47ab-4966-b309-b83dd8e6d2e4 req-ffa7c28e-4397-4ca6-913a-c5a96c06ff25 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received event network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:14:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00723ace-47ab-4966-b309-b83dd8e6d2e4 req-ffa7c28e-4397-4ca6-913a-c5a96c06ff25 service nova] Acquiring lock "99256cf6-676b-4e28-9c09-288d761020e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:14:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00723ace-47ab-4966-b309-b83dd8e6d2e4 req-ffa7c28e-4397-4ca6-913a-c5a96c06ff25 service nova] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:14:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-00723ace-47ab-4966-b309-b83dd8e6d2e4 req-ffa7c28e-4397-4ca6-913a-c5a96c06ff25 service nova] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:14:04 user nova-compute[71364]: DEBUG nova.compute.manager [req-00723ace-47ab-4966-b309-b83dd8e6d2e4 req-ffa7c28e-4397-4ca6-913a-c5a96c06ff25 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] No waiting events found dispatching network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:14:04 user nova-compute[71364]: WARNING nova.compute.manager [req-00723ace-47ab-4966-b309-b83dd8e6d2e4 req-ffa7c28e-4397-4ca6-913a-c5a96c06ff25 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received unexpected event network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance with vm_state building and task_state spawning.
Apr 11 22:14:04 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:14:04 user nova-compute[71364]: INFO nova.compute.manager [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Took 5.34 seconds to spawn the instance on the hypervisor.
Apr 11 22:14:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:14:04 user nova-compute[71364]: INFO nova.compute.manager [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Took 5.84 seconds to build instance.
Apr 11 22:14:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "99256cf6-676b-4e28-9c09-288d761020e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.924s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:14:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:14:05 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:14:06 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:14:06 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:14:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8602MB free_disk=26.265796661376953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:14:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:14:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:14:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3331e482-bd81-47da-9e66-eade6dd2edcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:14:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 99256cf6-676b-4e28-9c09-288d761020e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:14:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:14:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:14:06 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:14:06 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:14:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:14:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:14:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG nova.objects.instance [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lazy-loading 'info_cache' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updating instance_info_cache with network_info: [{"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:14:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:14:15 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:14:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:14:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-fc97c61f-ecf9-426d-804e-64d948cfb366 req-0cdf53b5-d67a-453e-99bf-b42bedc3ec75 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received event network-changed-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:14:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-fc97c61f-ecf9-426d-804e-64d948cfb366 req-0cdf53b5-d67a-453e-99bf-b42bedc3ec75 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Refreshing instance network info cache due to event network-changed-04ca38ad-28b6-4863-ad00-2d83b8d40fa9. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:14:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fc97c61f-ecf9-426d-804e-64d948cfb366 req-0cdf53b5-d67a-453e-99bf-b42bedc3ec75 service nova] Acquiring lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:14:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fc97c61f-ecf9-426d-804e-64d948cfb366 req-0cdf53b5-d67a-453e-99bf-b42bedc3ec75 service nova] Acquired lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:14:17 user nova-compute[71364]: DEBUG nova.network.neutron [req-fc97c61f-ecf9-426d-804e-64d948cfb366 req-0cdf53b5-d67a-453e-99bf-b42bedc3ec75 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Refreshing network info cache for port 04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:14:17 user nova-compute[71364]: DEBUG nova.network.neutron [req-fc97c61f-ecf9-426d-804e-64d948cfb366 req-0cdf53b5-d67a-453e-99bf-b42bedc3ec75 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updated VIF entry in instance network info cache for port 04ca38ad-28b6-4863-ad00-2d83b8d40fa9. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:14:17 user nova-compute[71364]: DEBUG nova.network.neutron [req-fc97c61f-ecf9-426d-804e-64d948cfb366 req-0cdf53b5-d67a-453e-99bf-b42bedc3ec75 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updating instance_info_cache with network_info: [{"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:14:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fc97c61f-ecf9-426d-804e-64d948cfb366 req-0cdf53b5-d67a-453e-99bf-b42bedc3ec75 service nova] Releasing lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:14:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:14:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:14:19 user nova-compute[71364]: INFO nova.compute.manager [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Shelving
Apr 11 22:14:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-e1af70b4-2990-4411-b25c-7734f51efb3d req-03cd8a2c-75e8-47ab-89ff-1975818bc688 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received event network-vif-unplugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:14:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e1af70b4-2990-4411-b25c-7734f51efb3d req-03cd8a2c-75e8-47ab-89ff-1975818bc688 service nova] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:14:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e1af70b4-2990-4411-b25c-7734f51efb3d req-03cd8a2c-75e8-47ab-89ff-1975818bc688 service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:14:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e1af70b4-2990-4411-b25c-7734f51efb3d req-03cd8a2c-75e8-47ab-89ff-1975818bc688 service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:14:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-e1af70b4-2990-4411-b25c-7734f51efb3d req-03cd8a2c-75e8-47ab-89ff-1975818bc688 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] No waiting events found dispatching network-vif-unplugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:14:20 user nova-compute[71364]: WARNING nova.compute.manager [req-e1af70b4-2990-4411-b25c-7734f51efb3d req-03cd8a2c-75e8-47ab-89ff-1975818bc688 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received unexpected event network-vif-unplugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance with vm_state active and task_state shelving.
Apr 11 22:14:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:20 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Instance destroyed successfully.
Apr 11 22:14:20 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Beginning cold snapshot process
Apr 11 22:14:20 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 22:14:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk /opt/stack/data/nova/instances/snapshots/tmpomt61t0j/7a8219d65e4848f6b7ab13781661709c {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:14:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk /opt/stack/data/nova/instances/snapshots/tmpomt61t0j/7a8219d65e4848f6b7ab13781661709c" returned: 0 in 0.438s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:14:21 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Snapshot extracted, beginning image upload
Apr 11 22:14:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-ad17a577-75e2-43b2-b873-78ac37bbeb7e req-c6812ff7-06f8-40ba-b8d9-394416bd7298 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received event network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:14:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ad17a577-75e2-43b2-b873-78ac37bbeb7e req-c6812ff7-06f8-40ba-b8d9-394416bd7298 service nova] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:14:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ad17a577-75e2-43b2-b873-78ac37bbeb7e req-c6812ff7-06f8-40ba-b8d9-394416bd7298 service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:14:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ad17a577-75e2-43b2-b873-78ac37bbeb7e req-c6812ff7-06f8-40ba-b8d9-394416bd7298 service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:14:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-ad17a577-75e2-43b2-b873-78ac37bbeb7e req-c6812ff7-06f8-40ba-b8d9-394416bd7298 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] No waiting events found dispatching network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:14:22 user nova-compute[71364]: WARNING nova.compute.manager [req-ad17a577-75e2-43b2-b873-78ac37bbeb7e req-c6812ff7-06f8-40ba-b8d9-394416bd7298 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received unexpected event network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance with vm_state active and task_state shelving_image_uploading.
Apr 11 22:14:23 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Snapshot image upload complete
Apr 11 22:14:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:14:23 user nova-compute[71364]: INFO nova.compute.manager [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Shelve offloading
Apr 11 22:14:23 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Instance destroyed successfully.
Apr 11 22:14:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:14:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:14:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquired lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:14:23 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG nova.network.neutron [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updating instance_info_cache with network_info: [{"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Releasing lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:24 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Instance destroyed successfully.
Apr 11 22:14:24 user nova-compute[71364]: DEBUG nova.objects.instance [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'resources' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1059229540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1059229540',id=37,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMatx2BIJDvb1/qWBbpl5ESBBxq/iMRYOnc9wjSJgIdAqgjjdFvwNzCgMnXbgpSi0jypGAgU2YpKOIBtnQi+JlOyNHiSni3dJBuvkgEe7mmK3+ZRHrtLRf+cvKNcO+lE4g==',key_name='tempest-keypair-2035792703',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:12:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='29e79d7c2e144af59f911973e79ba110',ramdisk_id='',reservation_id='r-f90giz2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-590407943',owner_user_name='tempest-AttachVolumeShelveTestJSON-590407943-project-member',shelved_at='2023-04-11T22:14:23.621729',shelved_host='user',shelved_image_id='bc0df6f6-1bc8-4d99-9568-c2167f8a8e9d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:14:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5898621881a4e799df121e1d5957f42',uuid=3331e482-bd81-47da-9e66-eade6dd2edcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converting VIF {"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:31:e4,bridge_name='br-int',has_traffic_filtering=True,id=04ca38ad-28b6-4863-ad00-2d83b8d40fa9,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca38ad-28') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG os_vif [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:31:e4,bridge_name='br-int',has_traffic_filtering=True,id=04ca38ad-28b6-4863-ad00-2d83b8d40fa9,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca38ad-28') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04ca38ad-28, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-149e842f-5723-4b01-b31e-ce1be47f66e4 req-fdb39909-4c16-4032-8177-3305a6f5bab7 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received event network-changed-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-149e842f-5723-4b01-b31e-ce1be47f66e4 req-fdb39909-4c16-4032-8177-3305a6f5bab7 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Refreshing instance network info cache due to event network-changed-04ca38ad-28b6-4863-ad00-2d83b8d40fa9. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-149e842f-5723-4b01-b31e-ce1be47f66e4 req-fdb39909-4c16-4032-8177-3305a6f5bab7 service nova] Acquiring lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-149e842f-5723-4b01-b31e-ce1be47f66e4 req-fdb39909-4c16-4032-8177-3305a6f5bab7 service nova] Acquired lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG nova.network.neutron [req-149e842f-5723-4b01-b31e-ce1be47f66e4 req-fdb39909-4c16-4032-8177-3305a6f5bab7 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Refreshing network info cache for port 04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:14:24 user nova-compute[71364]: INFO os_vif [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:31:e4,bridge_name='br-int',has_traffic_filtering=True,id=04ca38ad-28b6-4863-ad00-2d83b8d40fa9,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca38ad-28')
Apr 11 22:14:24 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Deleting instance files /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc_del
Apr 11 22:14:24 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Deletion of /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc_del complete
Apr 11 22:14:24 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Deleted allocations for instance 3331e482-bd81-47da-9e66-eade6dd2edcc
Apr 11 22:14:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:14:24 user nova-compute[71364]: DEBUG nova.objects.instance [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'numa_topology' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:14:25 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:14:25 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:14:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:14:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.395s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:14:25 user nova-compute[71364]: DEBUG nova.network.neutron [req-149e842f-5723-4b01-b31e-ce1be47f66e4 req-fdb39909-4c16-4032-8177-3305a6f5bab7 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updated VIF entry in instance network info cache for port 04ca38ad-28b6-4863-ad00-2d83b8d40fa9. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:14:25 user nova-compute[71364]: DEBUG nova.network.neutron [req-149e842f-5723-4b01-b31e-ce1be47f66e4 req-fdb39909-4c16-4032-8177-3305a6f5bab7 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updating instance_info_cache with network_info: [{"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap04ca38ad-28", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:14:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-149e842f-5723-4b01-b31e-ce1be47f66e4 req-fdb39909-4c16-4032-8177-3305a6f5bab7 service nova] Releasing lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:14:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:35 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251260.407977, 3331e482-bd81-47da-9e66-eade6dd2edcc => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:14:35 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] VM Stopped (Lifecycle Event)
Apr 11 22:14:35 user nova-compute[71364]: DEBUG nova.compute.manager [None req-fe71e82c-8341-4051-9adf-b6f26314ecf0 None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:14:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:14:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:14:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:14:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:14:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:14:58 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:14:58 user nova-compute[71364]: INFO nova.compute.claims [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Claim successful on node user
Apr 11 22:14:58 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:14:58 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:14:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:14:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:14:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:14:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:14:58 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:14:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:14:58 user nova-compute[71364]: INFO nova.virt.block_device [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Booting with volume snapshot 657c6a4c-a8c4-483e-a3ff-57d86bcc2851 at /dev/vda
Apr 11 22:14:58 user nova-compute[71364]: DEBUG nova.policy [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:14:59 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Successfully created port: 5b676148-29d7-4361-8205-c50f71a8eb6d {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:14:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:14:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Successfully updated port: 5b676148-29d7-4361-8205-c50f71a8eb6d {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:15:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "refresh_cache-becdfdba-6e2f-48c1-bbe2-0db2c72e276c" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:15:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquired lock "refresh_cache-becdfdba-6e2f-48c1-bbe2-0db2c72e276c" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:15:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:15:00 user nova-compute[71364]: DEBUG nova.compute.manager [req-3fce05e6-0080-46fe-b099-8e098cde8d72 req-90bfdbff-09b0-40d9-aba8-bf308d4e92d7 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Received event network-changed-5b676148-29d7-4361-8205-c50f71a8eb6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:15:00 user nova-compute[71364]: DEBUG nova.compute.manager [req-3fce05e6-0080-46fe-b099-8e098cde8d72 req-90bfdbff-09b0-40d9-aba8-bf308d4e92d7 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Refreshing instance network info cache due to event network-changed-5b676148-29d7-4361-8205-c50f71a8eb6d. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:15:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3fce05e6-0080-46fe-b099-8e098cde8d72 req-90bfdbff-09b0-40d9-aba8-bf308d4e92d7 service nova] Acquiring lock "refresh_cache-becdfdba-6e2f-48c1-bbe2-0db2c72e276c" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:15:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:15:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Updating instance_info_cache with network_info: [{"id": "5b676148-29d7-4361-8205-c50f71a8eb6d", "address": "fa:16:3e:78:4e:de", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b676148-29", "ovs_interfaceid": "5b676148-29d7-4361-8205-c50f71a8eb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:15:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Releasing lock "refresh_cache-becdfdba-6e2f-48c1-bbe2-0db2c72e276c" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:15:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Instance network_info: |[{"id": "5b676148-29d7-4361-8205-c50f71a8eb6d", "address": "fa:16:3e:78:4e:de", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b676148-29", "ovs_interfaceid": "5b676148-29d7-4361-8205-c50f71a8eb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:15:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3fce05e6-0080-46fe-b099-8e098cde8d72 req-90bfdbff-09b0-40d9-aba8-bf308d4e92d7 service nova] Acquired lock "refresh_cache-becdfdba-6e2f-48c1-bbe2-0db2c72e276c" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:15:00 user nova-compute[71364]: DEBUG nova.network.neutron [req-3fce05e6-0080-46fe-b099-8e098cde8d72 req-90bfdbff-09b0-40d9-aba8-bf308d4e92d7 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Refreshing network info cache for port 5b676148-29d7-4361-8205-c50f71a8eb6d {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:15:01 user nova-compute[71364]: DEBUG nova.network.neutron [req-3fce05e6-0080-46fe-b099-8e098cde8d72 req-90bfdbff-09b0-40d9-aba8-bf308d4e92d7 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Updated VIF entry in instance network info cache for port 5b676148-29d7-4361-8205-c50f71a8eb6d. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:15:01 user nova-compute[71364]: DEBUG nova.network.neutron [req-3fce05e6-0080-46fe-b099-8e098cde8d72 req-90bfdbff-09b0-40d9-aba8-bf308d4e92d7 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Updating instance_info_cache with network_info: [{"id": "5b676148-29d7-4361-8205-c50f71a8eb6d", "address": "fa:16:3e:78:4e:de", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b676148-29", "ovs_interfaceid": "5b676148-29d7-4361-8205-c50f71a8eb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:15:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3fce05e6-0080-46fe-b099-8e098cde8d72 req-90bfdbff-09b0-40d9-aba8-bf308d4e92d7 service nova] Releasing lock "refresh_cache-becdfdba-6e2f-48c1-bbe2-0db2c72e276c" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG os_brick.utils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae68169-3410-400f-964b-a7a8a31203d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71d89d7-02e6-4bcd-bd69-35d36a5517d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[87927f30-93e0-4ae2-8f74-c64ec9252c33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ea9459-1ba0-442d-bb58-5f7f28fa8713]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:15:04 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:15:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[77781ba4-83b2-4844-81aa-35c7b733e131]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG os_brick.utils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Updating existing volume attachment record: 575c40a5-e7cc-4209-b4cd-eec98badea3c {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:06 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:15:06 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:15:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8647MB free_disk=26.21894073486328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 99256cf6-676b-4e28-9c09-288d761020e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:15:06 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:15:07 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:15:07 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:15:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:15:08 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Creating image(s)
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Ensure instance console log exists: /opt/stack/data/nova/instances/becdfdba-6e2f-48c1-bbe2-0db2c72e276c/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Start _get_guest_xml network_info=[{"id": "5b676148-29d7-4361-8205-c50f71a8eb6d", "address": "fa:16:3e:78:4e:de", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b676148-29", "ovs_interfaceid": "5b676148-29d7-4361-8205-c50f71a8eb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbGidjuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'becdfdba-6e2f-48c1-bbe2-0db2c72e276c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd9af431d-b2f3-4dcb-ab71-8fd5a0daf607', 'serial': 'd9af431d-b2f3-4dcb-ab71-8fd5a0daf607'}, 'attachment_id': '575c40a5-e7cc-4209-b4cd-eec98badea3c', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:15:08 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:15:08 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbGidjuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:15:08 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:15:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:15:08 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:15:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:15:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:15:08 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:15:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b31d69-cbd3-450c-9748-23ebff601bb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:15:09 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36eb207-0029-4c29-a3aa-715f06d5aca8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607] added
Apr 11 22:15:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea92506-4305-4525-bcc1-65e8e7a311a1]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4aed2df-cf98-418d-bcd7-923765ebb710]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbGidjuZ {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NbGidjuZ" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee80b08-e257-4fff-b875-638410a33c3f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NbGidjuZ'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62ba2f6-7f95-4635-a271-cc5e8bdaa27f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8dae79-ad56-4976-9fda-eef2866f9de2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 22:15:09 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 22:15:09 user nova-compute[71364]:  {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:15:09 user nova-compute[71364]: WARNING os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 22:15:09 user nova-compute[71364]: 
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6ed1f4-211c-4973-a6d1-7433ca91af5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607, portal: 172.16.0.220,3260]
Apr 11 22:15:09 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607, portal: 172.16.0.220,3260] successful.
Apr 11 22:15:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f647fefe-1643-4ee7-accf-6d5efbff86c1]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f5b29b-0014-4731-be60-c999a8aec1de]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:15:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:15:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc00cafd-437c-4dc4-844e-236625e794c6]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbGidjuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26538336530373239', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538336530373239', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-327013399',display_name='tempest-TestVolumeBootPattern-server-327013399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-327013399',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-g64vay1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:14:59Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=becdfdba-6e2f-48c1-bbe2-0db2c72e276c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b676148-29d7-4361-8205-c50f71a8eb6d", "address": "fa:16:3e:78:4e:de", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b676148-29", "ovs_interfaceid": "5b676148-29d7-4361-8205-c50f71a8eb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "5b676148-29d7-4361-8205-c50f71a8eb6d", "address": "fa:16:3e:78:4e:de", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b676148-29", "ovs_interfaceid": "5b676148-29d7-4361-8205-c50f71a8eb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=5b676148-29d7-4361-8205-c50f71a8eb6d,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b676148-29') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG nova.objects.instance [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lazy-loading 'pci_devices' on Instance uuid becdfdba-6e2f-48c1-bbe2-0db2c72e276c {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:15:10 user nova-compute[71364]:   <uuid>becdfdba-6e2f-48c1-bbe2-0db2c72e276c</uuid>
Apr 11 22:15:10 user nova-compute[71364]:   <name>instance-00000027</name>
Apr 11 22:15:10 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:15:10 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:15:10 user nova-compute[71364]:   <metadata>
Apr 11 22:15:10 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:15:10 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:15:10 user nova-compute[71364]:       <nova:name>tempest-TestVolumeBootPattern-server-327013399</nova:name>
Apr 11 22:15:10 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:15:08</nova:creationTime>
Apr 11 22:15:10 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:15:10 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:15:10 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:15:10 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:15:10 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:15:10 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:15:10 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:15:10 user nova-compute[71364]:       <nova:owner>
Apr 11 22:15:10 user nova-compute[71364]:         <nova:user uuid="4fdb893b6ea3402788a89740355fa935">tempest-TestVolumeBootPattern-1208917682-project-member</nova:user>
Apr 11 22:15:10 user nova-compute[71364]:         <nova:project uuid="eb843e213c594ac28f864550ad68833b">tempest-TestVolumeBootPattern-1208917682</nova:project>
Apr 11 22:15:10 user nova-compute[71364]:       </nova:owner>
Apr 11 22:15:10 user nova-compute[71364]:       <nova:ports>
Apr 11 22:15:10 user nova-compute[71364]:         <nova:port uuid="5b676148-29d7-4361-8205-c50f71a8eb6d">
Apr 11 22:15:10 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 11 22:15:10 user nova-compute[71364]:         </nova:port>
Apr 11 22:15:10 user nova-compute[71364]:       </nova:ports>
Apr 11 22:15:10 user nova-compute[71364]:     </nova:instance>
Apr 11 22:15:10 user nova-compute[71364]:   </metadata>
Apr 11 22:15:10 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:15:10 user nova-compute[71364]:     <system>
Apr 11 22:15:10 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:15:10 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:15:10 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:15:10 user nova-compute[71364]:       <entry name="serial">becdfdba-6e2f-48c1-bbe2-0db2c72e276c</entry>
Apr 11 22:15:10 user nova-compute[71364]:       <entry name="uuid">becdfdba-6e2f-48c1-bbe2-0db2c72e276c</entry>
Apr 11 22:15:10 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:15:10 user nova-compute[71364]:     </system>
Apr 11 22:15:10 user nova-compute[71364]:   </sysinfo>
Apr 11 22:15:10 user nova-compute[71364]:   <os>
Apr 11 22:15:10 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:15:10 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:15:10 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:15:10 user nova-compute[71364]:   </os>
Apr 11 22:15:10 user nova-compute[71364]:   <features>
Apr 11 22:15:10 user nova-compute[71364]:     <acpi/>
Apr 11 22:15:10 user nova-compute[71364]:     <apic/>
Apr 11 22:15:10 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:15:10 user nova-compute[71364]:   </features>
Apr 11 22:15:10 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:15:10 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:15:10 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:15:10 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:15:10 user nova-compute[71364]:   </clock>
Apr 11 22:15:10 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:15:10 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:15:10 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:15:10 user nova-compute[71364]:   </cpu>
Apr 11 22:15:10 user nova-compute[71364]:   <devices>
Apr 11 22:15:10 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 22:15:10 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:15:10 user nova-compute[71364]:       <source dev="/dev/sdb"/>
Apr 11 22:15:10 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:15:10 user nova-compute[71364]:       <serial>d9af431d-b2f3-4dcb-ab71-8fd5a0daf607</serial>
Apr 11 22:15:10 user nova-compute[71364]:     </disk>
Apr 11 22:15:10 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:15:10 user nova-compute[71364]:       <mac address="fa:16:3e:78:4e:de"/>
Apr 11 22:15:10 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:15:10 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:15:10 user nova-compute[71364]:       <target dev="tap5b676148-29"/>
Apr 11 22:15:10 user nova-compute[71364]:     </interface>
Apr 11 22:15:10 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:15:10 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/becdfdba-6e2f-48c1-bbe2-0db2c72e276c/console.log" append="off"/>
Apr 11 22:15:10 user nova-compute[71364]:     </serial>
Apr 11 22:15:10 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:15:10 user nova-compute[71364]:     <video>
Apr 11 22:15:10 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:15:10 user nova-compute[71364]:     </video>
Apr 11 22:15:10 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:15:10 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:15:10 user nova-compute[71364]:     </rng>
Apr 11 22:15:10 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:15:10 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:15:10 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:15:10 user nova-compute[71364]:     </memballoon>
Apr 11 22:15:10 user nova-compute[71364]:   </devices>
Apr 11 22:15:10 user nova-compute[71364]: </domain>
Apr 11 22:15:10 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-327013399',display_name='tempest-TestVolumeBootPattern-server-327013399',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-327013399',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-g64vay1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:14:59Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=becdfdba-6e2f-48c1-bbe2-0db2c72e276c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b676148-29d7-4361-8205-c50f71a8eb6d", "address": "fa:16:3e:78:4e:de", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b676148-29", "ovs_interfaceid": "5b676148-29d7-4361-8205-c50f71a8eb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "5b676148-29d7-4361-8205-c50f71a8eb6d", "address": "fa:16:3e:78:4e:de", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b676148-29", "ovs_interfaceid": "5b676148-29d7-4361-8205-c50f71a8eb6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=5b676148-29d7-4361-8205-c50f71a8eb6d,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b676148-29') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG os_vif [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=5b676148-29d7-4361-8205-c50f71a8eb6d,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b676148-29') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b676148-29, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5b676148-29, col_values=(('external_ids', {'iface-id': '5b676148-29d7-4361-8205-c50f71a8eb6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:4e:de', 'vm-uuid': 'becdfdba-6e2f-48c1-bbe2-0db2c72e276c'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:10 user nova-compute[71364]: INFO os_vif [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=5b676148-29d7-4361-8205-c50f71a8eb6d,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b676148-29')
Apr 11 22:15:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:15:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] No VIF found with MAC fa:16:3e:78:4e:de, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:15:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-80d6bd6c-d02e-4e6a-a2aa-d03c09f55ec8 req-a2cf4b17-19f3-4966-bffa-e19d44f34c16 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Received event network-vif-plugged-5b676148-29d7-4361-8205-c50f71a8eb6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:15:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-80d6bd6c-d02e-4e6a-a2aa-d03c09f55ec8 req-a2cf4b17-19f3-4966-bffa-e19d44f34c16 service nova] Acquiring lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:15:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-80d6bd6c-d02e-4e6a-a2aa-d03c09f55ec8 req-a2cf4b17-19f3-4966-bffa-e19d44f34c16 service nova] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:15:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-80d6bd6c-d02e-4e6a-a2aa-d03c09f55ec8 req-a2cf4b17-19f3-4966-bffa-e19d44f34c16 service nova] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:15:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-80d6bd6c-d02e-4e6a-a2aa-d03c09f55ec8 req-a2cf4b17-19f3-4966-bffa-e19d44f34c16 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] No waiting events found dispatching network-vif-plugged-5b676148-29d7-4361-8205-c50f71a8eb6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:15:11 user nova-compute[71364]: WARNING nova.compute.manager [req-80d6bd6c-d02e-4e6a-a2aa-d03c09f55ec8 req-a2cf4b17-19f3-4966-bffa-e19d44f34c16 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Received unexpected event network-vif-plugged-5b676148-29d7-4361-8205-c50f71a8eb6d for instance with vm_state building and task_state spawning.
Apr 11 22:15:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:15:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:15:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:15:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251313.6786644, becdfdba-6e2f-48c1-bbe2-0db2c72e276c => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:15:13 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] VM Resumed (Lifecycle Event)
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:15:13 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Instance spawned successfully.
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:15:13 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251313.6799555, becdfdba-6e2f-48c1-bbe2-0db2c72e276c => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:15:13 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] VM Started (Lifecycle Event)
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:15:13 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:15:13 user nova-compute[71364]: INFO nova.compute.manager [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Took 4.86 seconds to spawn the instance on the hypervisor.
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-407750d7-8e86-4eac-a096-bd5ff4c1a20e req-5098b747-36da-4162-b9df-dc92e2134fe6 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Received event network-vif-plugged-5b676148-29d7-4361-8205-c50f71a8eb6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-407750d7-8e86-4eac-a096-bd5ff4c1a20e req-5098b747-36da-4162-b9df-dc92e2134fe6 service nova] Acquiring lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-407750d7-8e86-4eac-a096-bd5ff4c1a20e req-5098b747-36da-4162-b9df-dc92e2134fe6 service nova] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-407750d7-8e86-4eac-a096-bd5ff4c1a20e req-5098b747-36da-4162-b9df-dc92e2134fe6 service nova] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:15:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-407750d7-8e86-4eac-a096-bd5ff4c1a20e req-5098b747-36da-4162-b9df-dc92e2134fe6 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] No waiting events found dispatching network-vif-plugged-5b676148-29d7-4361-8205-c50f71a8eb6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:15:13 user nova-compute[71364]: WARNING nova.compute.manager [req-407750d7-8e86-4eac-a096-bd5ff4c1a20e req-5098b747-36da-4162-b9df-dc92e2134fe6 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Received unexpected event network-vif-plugged-5b676148-29d7-4361-8205-c50f71a8eb6d for instance with vm_state building and task_state spawning.
Apr 11 22:15:13 user nova-compute[71364]: INFO nova.compute.manager [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Took 15.42 seconds to build instance.
Apr 11 22:15:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.503s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:15:14 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:15:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:15:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-99256cf6-676b-4e28-9c09-288d761020e8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:15:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-99256cf6-676b-4e28-9c09-288d761020e8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:15:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:15:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Updating instance_info_cache with network_info: [{"id": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "address": "fa:16:3e:6c:b4:63", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a9e3be-a4", "ovs_interfaceid": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:15:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-99256cf6-676b-4e28-9c09-288d761020e8" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:15:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:15:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:17 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:15:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:45 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "99256cf6-676b-4e28-9c09-288d761020e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "99256cf6-676b-4e28-9c09-288d761020e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG nova.objects.instance [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lazy-loading 'flavor' on Instance uuid 99256cf6-676b-4e28-9c09-288d761020e8 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:15:48 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Ignoring supplied device name: /dev/vdb
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "99256cf6-676b-4e28-9c09-288d761020e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "99256cf6-676b-4e28-9c09-288d761020e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "99256cf6-676b-4e28-9c09-288d761020e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:15:48 user nova-compute[71364]: INFO nova.compute.manager [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Attaching volume 3efdb104-6a0b-4bf0-8b96-6501e9390248 to /dev/vdb
Apr 11 22:15:48 user nova-compute[71364]: DEBUG os_brick.utils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1f9935-c1df-4d97-a42e-3cd40a16d43c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07af574-eda5-45bc-8df9-60fbe38afb52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f962b3b6-ccb6-4b88-bd54-5cf0538fa1c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb85e71-db2c-4444-9e85-3fbc2b640478]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:15:48 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:15:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bf7742-79fb-4a02-8589-12861c286a07]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG os_brick.utils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:15:48 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Updating existing volume attachment record: 03929df7-efca-4092-8b4f-cd4a80f237eb {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:15:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASokafTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:15:52 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:15:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:15:52 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:15:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:15:52 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:15:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcf9bc3-3bac-45d1-ac59-23aed23c0a54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:15:52 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b6a28b-7db3-43be-b67d-abf5e97d855c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248] added
Apr 11 22:15:52 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b89c2c-65fa-4842-9ba3-e5ad950bf47c]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d237a7-7ff4-4e39-9cfd-8b96a8059c92]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:52 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASokafTt {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ASokafTt" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01e69d0-6f1f-4383-9579-6d626cf4f550]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ASokafTt'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[427a6671-29a3-46ca-acf1-fa61ccb8645f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e618c3-9b45-4360-9dff-b3534707484d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:15:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:15:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5271e69f-388b-4d0a-98ee-8bb1ed3085f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248, portal: 172.16.0.220,3260]
Apr 11 22:15:53 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248, portal: 172.16.0.220,3260] successful.
Apr 11 22:15:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b136569d-6657-4da7-85c2-862d2d8c021c]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c82c48-f4c3-4dd7-b75a-2d4dbb326cc2]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:15:53 user nova-compute[71364]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 (non-flash)
Apr 11 22:15:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:15:53 user nova-compute[71364]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 (non-flash)
Apr 11 22:15:53 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dbb7cd-84cf-40a3-94f9-a5d53cd8c9cc]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:15:53 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASokafTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:15:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:15:54 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26261306662313531', 'path': '/dev/sdc'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:15:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261306662313531', 'path': '/dev/sdc'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:15:54 user nova-compute[71364]: DEBUG nova.objects.instance [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lazy-loading 'flavor' on Instance uuid 99256cf6-676b-4e28-9c09-288d761020e8 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:15:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 22:15:54 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:15:54 user nova-compute[71364]:   <source dev="/dev/sdc"/>
Apr 11 22:15:54 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:15:54 user nova-compute[71364]:   <serial>3efdb104-6a0b-4bf0-8b96-6501e9390248</serial>
Apr 11 22:15:54 user nova-compute[71364]: </disk>
Apr 11 22:15:54 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 22:15:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:15:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:15:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] No VIF found with MAC fa:16:3e:6c:b4:63, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:15:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "99256cf6-676b-4e28-9c09-288d761020e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.423s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:15:55 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:15:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:00 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "99256cf6-676b-4e28-9c09-288d761020e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "99256cf6-676b-4e28-9c09-288d761020e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:01 user nova-compute[71364]: INFO nova.compute.manager [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Detaching volume 3efdb104-6a0b-4bf0-8b96-6501e9390248
Apr 11 22:16:01 user nova-compute[71364]: INFO nova.virt.block_device [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Attempting to driver detach volume 3efdb104-6a0b-4bf0-8b96-6501e9390248 from mountpoint /dev/vdb
Apr 11 22:16:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Attempting to detach device vdb from instance 99256cf6-676b-4e28-9c09-288d761020e8 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:16:01 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:16:01 user nova-compute[71364]:   <source dev="/dev/sdc"/>
Apr 11 22:16:01 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:16:01 user nova-compute[71364]:   <serial>3efdb104-6a0b-4bf0-8b96-6501e9390248</serial>
Apr 11 22:16:01 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:16:01 user nova-compute[71364]: </disk>
Apr 11 22:16:01 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:16:01 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Successfully detached device vdb from instance 99256cf6-676b-4e28-9c09-288d761020e8 from the persistent domain config.
Apr 11 22:16:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99256cf6-676b-4e28-9c09-288d761020e8 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:16:01 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:16:01 user nova-compute[71364]:   <source dev="/dev/sdc"/>
Apr 11 22:16:01 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:16:01 user nova-compute[71364]:   <serial>3efdb104-6a0b-4bf0-8b96-6501e9390248</serial>
Apr 11 22:16:01 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:16:01 user nova-compute[71364]: </disk>
Apr 11 22:16:01 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "99256cf6-676b-4e28-9c09-288d761020e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681251361.6491113, 99256cf6-676b-4e28-9c09-288d761020e8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99256cf6-676b-4e28-9c09-288d761020e8 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:16:01 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Successfully detached device vdb from instance 99256cf6-676b-4e28-9c09-288d761020e8 from the live domain config.
Apr 11 22:16:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASokafTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:16:01 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef9efaa-72a8-4057-b7fa-316eb1898572]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:16:01 user nova-compute[71364]: No targets found.
Apr 11 22:16:01 user nova-compute[71364]: iSNS:
Apr 11 22:16:01 user nova-compute[71364]: No targets found.
Apr 11 22:16:01 user nova-compute[71364]: STATIC:
Apr 11 22:16:01 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607
Apr 11 22:16:01 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:16:01 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:16:01 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248
Apr 11 22:16:01 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:16:01 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:16:01 user nova-compute[71364]: FIRMWARE:
Apr 11 22:16:01 user nova-compute[71364]: No targets found.
Apr 11 22:16:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:16:01 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:16:01 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbf37d1-e7e2-4f5a-bb29-242cfbc5871c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c49a4c-5de6-4350-a209-d9b6a142cc68]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:16:01 user nova-compute[71364]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 (non-flash)
Apr 11 22:16:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:16:01 user nova-compute[71364]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 (non-flash)
Apr 11 22:16:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bf0296950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248'): ({'sdc'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Removing single pathed devices sdc {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ba40bb-406a-4fc0-9b5e-9dc22a17b595]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6d6a0a-013b-449c-aa93-b1073ebb9d07]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Flushing IO for device /dev/sdc {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[065095f3-6198-4e73-b2f9-36799df34e3a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf0bbcf-20cc-4ddf-9dc8-0628c65c479b]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f760d4bf-60ab-4b1d-91cc-a9d307423af7]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9338a35f-5e0c-4e93-a975-ef91abc691ac]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248, portal: 172.16.0.220,3260]
Apr 11 22:16:01 user nova-compute[71364]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248, portal: 172.16.0.220,3260] successful.
Apr 11 22:16:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d7c8fd-f072-4642-b3dd-e962c2cef141]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] <== disconnect_volume: return (299ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:16:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:16:02 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lazy-loading 'flavor' on Instance uuid 99256cf6-676b-4e28-9c09-288d761020e8 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:16:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "99256cf6-676b-4e28-9c09-288d761020e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.681s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "99256cf6-676b-4e28-9c09-288d761020e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.550s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "99256cf6-676b-4e28-9c09-288d761020e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:02 user nova-compute[71364]: INFO nova.compute.manager [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Terminating instance
Apr 11 22:16:02 user nova-compute[71364]: DEBUG nova.compute.manager [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:16:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-7b3393cc-4800-42ba-a90b-21db89b9e3a0 req-df253687-e2df-45cc-ade3-bb17d5fcaa9a service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received event network-vif-unplugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7b3393cc-4800-42ba-a90b-21db89b9e3a0 req-df253687-e2df-45cc-ade3-bb17d5fcaa9a service nova] Acquiring lock "99256cf6-676b-4e28-9c09-288d761020e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7b3393cc-4800-42ba-a90b-21db89b9e3a0 req-df253687-e2df-45cc-ade3-bb17d5fcaa9a service nova] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7b3393cc-4800-42ba-a90b-21db89b9e3a0 req-df253687-e2df-45cc-ade3-bb17d5fcaa9a service nova] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-7b3393cc-4800-42ba-a90b-21db89b9e3a0 req-df253687-e2df-45cc-ade3-bb17d5fcaa9a service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] No waiting events found dispatching network-vif-unplugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-7b3393cc-4800-42ba-a90b-21db89b9e3a0 req-df253687-e2df-45cc-ade3-bb17d5fcaa9a service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received event network-vif-unplugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:03 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Instance destroyed successfully.
Apr 11 22:16:03 user nova-compute[71364]: DEBUG nova.objects.instance [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lazy-loading 'resources' on Instance uuid 99256cf6-676b-4e28-9c09-288d761020e8 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:13:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1497432760',display_name='tempest-VolumesSnapshotTestJSON-instance-1497432760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1497432760',id=38,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:14:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b2e33082edb407983882075d3237264',ramdisk_id='',reservation_id='r-9axm532w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-279092346',owner_user_name='tempest-VolumesSnapshotTestJSON-279092346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:14:04Z,user_data=None,user_id='d28c7ae9f6dc4f06a7202bcab3afb0ac',uuid=99256cf6-676b-4e28-9c09-288d761020e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "address": "fa:16:3e:6c:b4:63", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a9e3be-a4", "ovs_interfaceid": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Converting VIF {"id": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "address": "fa:16:3e:6c:b4:63", "network": {"id": "65f8b365-752d-40d7-aa38-7980a188a4a5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-981281152-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "4b2e33082edb407983882075d3237264", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18a9e3be-a4", "ovs_interfaceid": "18a9e3be-a4c2-4d8f-838b-d07722cd7647", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b4:63,bridge_name='br-int',has_traffic_filtering=True,id=18a9e3be-a4c2-4d8f-838b-d07722cd7647,network=Network(65f8b365-752d-40d7-aa38-7980a188a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a9e3be-a4') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG os_vif [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b4:63,bridge_name='br-int',has_traffic_filtering=True,id=18a9e3be-a4c2-4d8f-838b-d07722cd7647,network=Network(65f8b365-752d-40d7-aa38-7980a188a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a9e3be-a4') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18a9e3be-a4, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:03 user nova-compute[71364]: INFO os_vif [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b4:63,bridge_name='br-int',has_traffic_filtering=True,id=18a9e3be-a4c2-4d8f-838b-d07722cd7647,network=Network(65f8b365-752d-40d7-aa38-7980a188a4a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18a9e3be-a4')
Apr 11 22:16:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ASokafTt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:16:03 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:16:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[66475523-4a4d-47a0-8bcd-349dfafb13f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:16:03 user nova-compute[71364]: No targets found.
Apr 11 22:16:03 user nova-compute[71364]: iSNS:
Apr 11 22:16:03 user nova-compute[71364]: No targets found.
Apr 11 22:16:03 user nova-compute[71364]: STATIC:
Apr 11 22:16:03 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607
Apr 11 22:16:03 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:16:03 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:16:03 user nova-compute[71364]: FIRMWARE:
Apr 11 22:16:03 user nova-compute[71364]: No targets found.
Apr 11 22:16:03 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:16:03 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:16:03 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3efdb104-6a0b-4bf0-8b96-6501e9390248', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac1f1d1-4068-42ff-a8ed-8f341fb85a68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9f1bb2-6385-44d7-8810-ae410c829ba7]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:16:03 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:16:03 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bd06cde10>, {}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Disconnecting from: [] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.088s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] <== disconnect_volume: return (90ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:16:03 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Deleting instance files /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8_del
Apr 11 22:16:03 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Deletion of /opt/stack/data/nova/instances/99256cf6-676b-4e28-9c09-288d761020e8_del complete
Apr 11 22:16:03 user nova-compute[71364]: INFO nova.compute.manager [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 11 22:16:03 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:16:03 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:16:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:04 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:16:04 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Took 0.48 seconds to deallocate network for instance.
Apr 11 22:16:04 user nova-compute[71364]: WARNING nova.volume.cinder [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Attachment 03929df7-efca-4092-8b4f-cd4a80f237eb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 03929df7-efca-4092-8b4f-cd4a80f237eb. (HTTP 404) (Request-ID: req-a646b043-201d-416e-986c-783f919482cd)
Apr 11 22:16:04 user nova-compute[71364]: INFO nova.compute.manager [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Took 0.02 seconds to detach 1 volumes for instance.
Apr 11 22:16:04 user nova-compute[71364]: DEBUG nova.compute.manager [req-049672a0-b485-46c9-aca3-00b72a0f1512 req-cf2d8c8c-93b3-4b6b-bbf0-4abd90322175 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received event network-vif-deleted-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:16:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:04 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:16:04 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:16:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:04 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Deleted allocations for instance 99256cf6-676b-4e28-9c09-288d761020e8
Apr 11 22:16:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "99256cf6-676b-4e28-9c09-288d761020e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.831s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received event network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Acquiring lock "99256cf6-676b-4e28-9c09-288d761020e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] No waiting events found dispatching network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:16:05 user nova-compute[71364]: WARNING nova.compute.manager [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received unexpected event network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance with vm_state deleted and task_state None.
Apr 11 22:16:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received event network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Acquiring lock "99256cf6-676b-4e28-9c09-288d761020e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] No waiting events found dispatching network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:16:05 user nova-compute[71364]: WARNING nova.compute.manager [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received unexpected event network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance with vm_state deleted and task_state None.
Apr 11 22:16:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received event network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Acquiring lock "99256cf6-676b-4e28-9c09-288d761020e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] No waiting events found dispatching network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:16:05 user nova-compute[71364]: WARNING nova.compute.manager [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received unexpected event network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance with vm_state deleted and task_state None.
Apr 11 22:16:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received event network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Acquiring lock "99256cf6-676b-4e28-9c09-288d761020e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Lock "99256cf6-676b-4e28-9c09-288d761020e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] No waiting events found dispatching network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:16:05 user nova-compute[71364]: WARNING nova.compute.manager [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Received unexpected event network-vif-plugged-18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance with vm_state deleted and task_state None.
Apr 11 22:16:06 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:16:06 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:16:06 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:16:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8617MB free_disk=26.22442626953125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing inventories for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating ProviderTree inventory for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating inventory in ProviderTree for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing aggregate associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, aggregates: None {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing trait associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:16:06 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:16:07 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:16:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:09 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:11 user nova-compute[71364]: INFO nova.compute.manager [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Unshelving
Apr 11 22:16:11 user nova-compute[71364]: INFO nova.virt.block_device [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Booting with volume 327322e4-555d-4e26-aab2-635279b0cec2 at /dev/vdc
Apr 11 22:16:11 user nova-compute[71364]: DEBUG os_brick.utils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:16:11 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:11 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:11 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5b7787-5a9f-44ad-b004-2b4469ab0b09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:11 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:11 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:11 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28c9fc0-60a3-402f-a7f0-599e06ebd0c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:11 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:12 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ce4325-13c0-46dc-a8be-3648d4312499]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:12 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe9745-0248-4872-adb9-12b7fbe5ecbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:16:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:16:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:16:12 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:16:12 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce05fcd-fbeb-47b3-8522-1ec42745111a]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:16:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:16:12 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:16:12 user nova-compute[71364]: DEBUG os_brick.utils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:16:12 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updating existing volume attachment record: 3dd3be1d-d6c3-4a3d-b130-62100274d63f {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:16:13 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:13 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:13 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:13 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 22:16:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] There are 0 instances to clean {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 22:16:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:16:14 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:14 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:16:15 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-becdfdba-6e2f-48c1-bbe2-0db2c72e276c" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-becdfdba-6e2f-48c1-bbe2-0db2c72e276c" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG nova.objects.instance [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lazy-loading 'info_cache' on Instance uuid becdfdba-6e2f-48c1-bbe2-0db2c72e276c {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG nova.objects.instance [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'pci_requests' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG nova.objects.instance [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'numa_topology' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:16:16 user nova-compute[71364]: INFO nova.compute.claims [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Claim successful on node user
Apr 11 22:16:16 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Updating instance_info_cache with network_info: [{"id": "5b676148-29d7-4361-8205-c50f71a8eb6d", "address": "fa:16:3e:78:4e:de", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b676148-29", "ovs_interfaceid": "5b676148-29d7-4361-8205-c50f71a8eb6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-becdfdba-6e2f-48c1-bbe2-0db2c72e276c" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:16:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:16:16 user nova-compute[71364]: INFO nova.network.neutron [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updating port 04ca38ad-28b6-4863-ad00-2d83b8d40fa9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquired lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG nova.network.neutron [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-16ba579e-bdde-4916-bd7b-4d47ad43b240 req-48247eb7-4b1c-4ee5-af7b-547b6e011ff8 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received event network-changed-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-16ba579e-bdde-4916-bd7b-4d47ad43b240 req-48247eb7-4b1c-4ee5-af7b-547b6e011ff8 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Refreshing instance network info cache due to event network-changed-04ca38ad-28b6-4863-ad00-2d83b8d40fa9. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-16ba579e-bdde-4916-bd7b-4d47ad43b240 req-48247eb7-4b1c-4ee5-af7b-547b6e011ff8 service nova] Acquiring lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG nova.network.neutron [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updating instance_info_cache with network_info: [{"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Releasing lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:16:17 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Creating image(s)
Apr 11 22:16:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "/opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "/opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "/opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.021s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG nova.objects.instance [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-16ba579e-bdde-4916-bd7b-4d47ad43b240 req-48247eb7-4b1c-4ee5-af7b-547b6e011ff8 service nova] Acquired lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG nova.network.neutron [req-16ba579e-bdde-4916-bd7b-4d47ad43b240 req-48247eb7-4b1c-4ee5-af7b-547b6e011ff8 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Refreshing network info cache for port 04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "663141c000b0a5747d1e47b16df0e584bb67d413" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "663141c000b0a5747d1e47b16df0e584bb67d413" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413.part --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:18 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:18 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251363.5851219, 99256cf6-676b-4e28-9c09-288d761020e8 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:16:18 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] VM Stopped (Lifecycle Event)
Apr 11 22:16:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-d3b00e0c-0b37-4f66-812f-832a76155575 None None] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:16:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413.part --force-share --output=json" returned: 0 in 0.137s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:18 user nova-compute[71364]: DEBUG nova.virt.images [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] bc0df6f6-1bc8-4d99-9568-c2167f8a8e9d was qcow2, converting to raw {{(pid=71364) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 22:16:18 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 22:16:18 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413.part /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413.converted {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG nova.network.neutron [req-16ba579e-bdde-4916-bd7b-4d47ad43b240 req-48247eb7-4b1c-4ee5-af7b-547b6e011ff8 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updated VIF entry in instance network info cache for port 04ca38ad-28b6-4863-ad00-2d83b8d40fa9. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG nova.network.neutron [req-16ba579e-bdde-4916-bd7b-4d47ad43b240 req-48247eb7-4b1c-4ee5-af7b-547b6e011ff8 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updating instance_info_cache with network_info: [{"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-16ba579e-bdde-4916-bd7b-4d47ad43b240 req-48247eb7-4b1c-4ee5-af7b-547b6e011ff8 service nova] Releasing lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413.part /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413.converted" returned: 0 in 0.414s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413.converted --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "663141c000b0a5747d1e47b16df0e584bb67d413" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.644s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413 --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "663141c000b0a5747d1e47b16df0e584bb67d413" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "663141c000b0a5747d1e47b16df0e584bb67d413" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413 --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413,backing_fmt=raw /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413,backing_fmt=raw /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk 1073741824" returned: 0 in 0.052s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "663141c000b0a5747d1e47b16df0e584bb67d413" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413 --force-share --output=json" returned: 0 in 0.154s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:19 user nova-compute[71364]: DEBUG nova.objects.instance [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'migration_context' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:16:19 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Rebasing disk image.
Apr 11 22:16:19 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:20 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71364) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 22:16:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 -F raw /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 -F raw /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk" returned: 0 in 1.901s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Ensure instance console log exists: /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Start _get_guest_xml network_info=[{"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='a0b433ffebd9cce1600d9280937ce509',container_format='bare',created_at=2023-04-11T22:14:20Z,direct_url=<?>,disk_format='qcow2',id=bc0df6f6-1bc8-4d99-9568-c2167f8a8e9d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1059229540-shelved',owner='29e79d7c2e144af59f911973e79ba110',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T22:14:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eSzDvYZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '3331e482-bd81-47da-9e66-eade6dd2edcc', 'attached_at': '', 'detached_at': '', 'volume_id': '327322e4-555d-4e26-aab2-635279b0cec2', 'serial': '327322e4-555d-4e26-aab2-635279b0cec2'}, 'attachment_id': '3dd3be1d-d6c3-4a3d-b130-62100274d63f', 'mount_device': '/dev/vdc', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:16:21 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:16:21 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a0b433ffebd9cce1600d9280937ce509',container_format='bare',created_at=2023-04-11T22:14:20Z,direct_url=<?>,disk_format='qcow2',id=bc0df6f6-1bc8-4d99-9568-c2167f8a8e9d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1059229540-shelved',owner='29e79d7c2e144af59f911973e79ba110',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T22:14:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:16:21 user nova-compute[71364]: DEBUG nova.objects.instance [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eSzDvYZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:16:22 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:16:22 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:16:22 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[64148cd6-6346-413f-a769-20dba6236a88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:16:22 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6593f3b-6428-480b-8bb1-cdf29de593ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2] added
Apr 11 22:16:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0b2bb9-79c0-4f7b-8433-d5cf5566781d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[587b2bad-5740-4539-a10a-46750d5f7f85]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eSzDvYZK {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eSzDvYZK" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c27d2ad-f139-4629-b6d7-0d89e37b842a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eSzDvYZK'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aa06f9-9d38-4cd3-9f5f-ff355e587204]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bf46ca-e910-4de3-9fa3-520769b450fa]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:16:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:16:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd48929-77db-4dd1-aa0c-81de8de3b383]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2, portal: 172.16.0.220,3260]
Apr 11 22:16:22 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2, portal: 172.16.0.220,3260] successful.
Apr 11 22:16:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da7092f-4694-4c08-a207-ee91cc4fabd1]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2f0b28-d7a1-44da-85b2-b8c1db679764]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:16:22 user nova-compute[71364]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)
Apr 11 22:16:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:16:22 user nova-compute[71364]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)
Apr 11 22:16:22 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[154c2bb0-a433-404e-be33-fba484cd9fc8]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:16:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eSzDvYZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26362663530316262', 'path': '/dev/sdc'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362663530316262', 'path': '/dev/sdc'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T22:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1059229540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1059229540',id=37,image_ref='bc0df6f6-1bc8-4d99-9568-c2167f8a8e9d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2035792703',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:12:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='29e79d7c2e144af59f911973e79ba110',ramdisk_id='',reservation_id='r-f90giz2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-590407943',owner_user_name='tempest-AttachVolumeShelveTestJSON-590407943-project-member',shelved_at='2023-04-11T22:14:23.621729',shelved_host='user',shelved_image_id='bc0df6f6-1bc8-4d99-9568-c2167f8a8e9d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5898621881a4e799df121e1d5957f42',uuid=3331e482-bd81-47da-9e66-eade6dd2edcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converting VIF {"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:31:e4,bridge_name='br-int',has_traffic_filtering=True,id=04ca38ad-28b6-4863-ad00-2d83b8d40fa9,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca38ad-28') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG nova.objects.instance [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'pci_devices' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:16:23 user nova-compute[71364]:   <uuid>3331e482-bd81-47da-9e66-eade6dd2edcc</uuid>
Apr 11 22:16:23 user nova-compute[71364]:   <name>instance-00000025</name>
Apr 11 22:16:23 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:16:23 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:16:23 user nova-compute[71364]:   <metadata>
Apr 11 22:16:23 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:16:23 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:16:23 user nova-compute[71364]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1059229540</nova:name>
Apr 11 22:16:23 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:16:21</nova:creationTime>
Apr 11 22:16:23 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:16:23 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:16:23 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:16:23 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:16:23 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:16:23 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:16:23 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:16:23 user nova-compute[71364]:       <nova:owner>
Apr 11 22:16:23 user nova-compute[71364]:         <nova:user uuid="e5898621881a4e799df121e1d5957f42">tempest-AttachVolumeShelveTestJSON-590407943-project-member</nova:user>
Apr 11 22:16:23 user nova-compute[71364]:         <nova:project uuid="29e79d7c2e144af59f911973e79ba110">tempest-AttachVolumeShelveTestJSON-590407943</nova:project>
Apr 11 22:16:23 user nova-compute[71364]:       </nova:owner>
Apr 11 22:16:23 user nova-compute[71364]:       <nova:root type="image" uuid="bc0df6f6-1bc8-4d99-9568-c2167f8a8e9d"/>
Apr 11 22:16:23 user nova-compute[71364]:       <nova:ports>
Apr 11 22:16:23 user nova-compute[71364]:         <nova:port uuid="04ca38ad-28b6-4863-ad00-2d83b8d40fa9">
Apr 11 22:16:23 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 22:16:23 user nova-compute[71364]:         </nova:port>
Apr 11 22:16:23 user nova-compute[71364]:       </nova:ports>
Apr 11 22:16:23 user nova-compute[71364]:     </nova:instance>
Apr 11 22:16:23 user nova-compute[71364]:   </metadata>
Apr 11 22:16:23 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:16:23 user nova-compute[71364]:     <system>
Apr 11 22:16:23 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:16:23 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:16:23 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:16:23 user nova-compute[71364]:       <entry name="serial">3331e482-bd81-47da-9e66-eade6dd2edcc</entry>
Apr 11 22:16:23 user nova-compute[71364]:       <entry name="uuid">3331e482-bd81-47da-9e66-eade6dd2edcc</entry>
Apr 11 22:16:23 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:16:23 user nova-compute[71364]:     </system>
Apr 11 22:16:23 user nova-compute[71364]:   </sysinfo>
Apr 11 22:16:23 user nova-compute[71364]:   <os>
Apr 11 22:16:23 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:16:23 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:16:23 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:16:23 user nova-compute[71364]:   </os>
Apr 11 22:16:23 user nova-compute[71364]:   <features>
Apr 11 22:16:23 user nova-compute[71364]:     <acpi/>
Apr 11 22:16:23 user nova-compute[71364]:     <apic/>
Apr 11 22:16:23 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:16:23 user nova-compute[71364]:   </features>
Apr 11 22:16:23 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:16:23 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:16:23 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:16:23 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:16:23 user nova-compute[71364]:   </clock>
Apr 11 22:16:23 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:16:23 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:16:23 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:16:23 user nova-compute[71364]:   </cpu>
Apr 11 22:16:23 user nova-compute[71364]:   <devices>
Apr 11 22:16:23 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:16:23 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:16:23 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk"/>
Apr 11 22:16:23 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:16:23 user nova-compute[71364]:     </disk>
Apr 11 22:16:23 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 22:16:23 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:16:23 user nova-compute[71364]:       <source dev="/dev/sdc"/>
Apr 11 22:16:23 user nova-compute[71364]:       <target dev="vdc" bus="virtio"/>
Apr 11 22:16:23 user nova-compute[71364]:       <serial>327322e4-555d-4e26-aab2-635279b0cec2</serial>
Apr 11 22:16:23 user nova-compute[71364]:     </disk>
Apr 11 22:16:23 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:16:23 user nova-compute[71364]:       <mac address="fa:16:3e:da:31:e4"/>
Apr 11 22:16:23 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:16:23 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:16:23 user nova-compute[71364]:       <target dev="tap04ca38ad-28"/>
Apr 11 22:16:23 user nova-compute[71364]:     </interface>
Apr 11 22:16:23 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:16:23 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/console.log" append="off"/>
Apr 11 22:16:23 user nova-compute[71364]:     </serial>
Apr 11 22:16:23 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:16:23 user nova-compute[71364]:     <video>
Apr 11 22:16:23 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:16:23 user nova-compute[71364]:     </video>
Apr 11 22:16:23 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:16:23 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:16:23 user nova-compute[71364]:     </rng>
Apr 11 22:16:23 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:16:23 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:16:23 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:16:23 user nova-compute[71364]:     </memballoon>
Apr 11 22:16:23 user nova-compute[71364]:   </devices>
Apr 11 22:16:23 user nova-compute[71364]: </domain>
Apr 11 22:16:23 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T22:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1059229540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1059229540',id=37,image_ref='bc0df6f6-1bc8-4d99-9568-c2167f8a8e9d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2035792703',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:12:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='29e79d7c2e144af59f911973e79ba110',ramdisk_id='',reservation_id='r-f90giz2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-590407943',owner_user_name='tempest-AttachVolumeShelveTestJSON-590407943-project-member',shelved_at='2023-04-11T22:14:23.621729',shelved_host='user',shelved_image_id='bc0df6f6-1bc8-4d99-9568-c2167f8a8e9d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:16:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5898621881a4e799df121e1d5957f42',uuid=3331e482-bd81-47da-9e66-eade6dd2edcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converting VIF {"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:31:e4,bridge_name='br-int',has_traffic_filtering=True,id=04ca38ad-28b6-4863-ad00-2d83b8d40fa9,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca38ad-28') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG os_vif [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:31:e4,bridge_name='br-int',has_traffic_filtering=True,id=04ca38ad-28b6-4863-ad00-2d83b8d40fa9,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca38ad-28') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04ca38ad-28, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04ca38ad-28, col_values=(('external_ids', {'iface-id': '04ca38ad-28b6-4863-ad00-2d83b8d40fa9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:31:e4', 'vm-uuid': '3331e482-bd81-47da-9e66-eade6dd2edcc'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:23 user nova-compute[71364]: INFO os_vif [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:31:e4,bridge_name='br-int',has_traffic_filtering=True,id=04ca38ad-28b6-4863-ad00-2d83b8d40fa9,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca38ad-28')
Apr 11 22:16:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:16:23 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] No VIF found with MAC fa:16:3e:da:31:e4, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:16:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-505dbe37-7ceb-4c01-877a-cd1a47de9dda req-cc34aac1-db82-4088-b4d6-7ae2feeb3ce1 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received event network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:16:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-505dbe37-7ceb-4c01-877a-cd1a47de9dda req-cc34aac1-db82-4088-b4d6-7ae2feeb3ce1 service nova] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-505dbe37-7ceb-4c01-877a-cd1a47de9dda req-cc34aac1-db82-4088-b4d6-7ae2feeb3ce1 service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-505dbe37-7ceb-4c01-877a-cd1a47de9dda req-cc34aac1-db82-4088-b4d6-7ae2feeb3ce1 service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-505dbe37-7ceb-4c01-877a-cd1a47de9dda req-cc34aac1-db82-4088-b4d6-7ae2feeb3ce1 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] No waiting events found dispatching network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:16:25 user nova-compute[71364]: WARNING nova.compute.manager [req-505dbe37-7ceb-4c01-877a-cd1a47de9dda req-cc34aac1-db82-4088-b4d6-7ae2feeb3ce1 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received unexpected event network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 22:16:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:26 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:27 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251387.1193652, 3331e482-bd81-47da-9e66-eade6dd2edcc => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:16:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] VM Resumed (Lifecycle Event)
Apr 11 22:16:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:16:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:16:27 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Instance spawned successfully.
Apr 11 22:16:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:16:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-26a8f830-2a7b-4d05-b26e-3eadcdd1da2e req-8f8e331e-0385-417e-83f2-6c6028406bd5 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received event network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:16:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-26a8f830-2a7b-4d05-b26e-3eadcdd1da2e req-8f8e331e-0385-417e-83f2-6c6028406bd5 service nova] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-26a8f830-2a7b-4d05-b26e-3eadcdd1da2e req-8f8e331e-0385-417e-83f2-6c6028406bd5 service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-26a8f830-2a7b-4d05-b26e-3eadcdd1da2e req-8f8e331e-0385-417e-83f2-6c6028406bd5 service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-26a8f830-2a7b-4d05-b26e-3eadcdd1da2e req-8f8e331e-0385-417e-83f2-6c6028406bd5 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] No waiting events found dispatching network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:16:27 user nova-compute[71364]: WARNING nova.compute.manager [req-26a8f830-2a7b-4d05-b26e-3eadcdd1da2e req-8f8e331e-0385-417e-83f2-6c6028406bd5 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received unexpected event network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 22:16:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:16:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:16:27 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251387.122568, 3331e482-bd81-47da-9e66-eade6dd2edcc => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:16:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] VM Started (Lifecycle Event)
Apr 11 22:16:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:16:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:16:27 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:16:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:16:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.643s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:44 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:16:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:16:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid becdfdba-6e2f-48c1-bbe2-0db2c72e276c {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:16:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:49 user nova-compute[71364]: INFO nova.compute.manager [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Terminating instance
Apr 11 22:16:49 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-ce6d3fd5-3de7-4285-88d2-b3c74f33d768 req-49bf6615-0e2e-49d5-8d72-fa418a601fa3 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Received event network-vif-unplugged-5b676148-29d7-4361-8205-c50f71a8eb6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ce6d3fd5-3de7-4285-88d2-b3c74f33d768 req-49bf6615-0e2e-49d5-8d72-fa418a601fa3 service nova] Acquiring lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ce6d3fd5-3de7-4285-88d2-b3c74f33d768 req-49bf6615-0e2e-49d5-8d72-fa418a601fa3 service nova] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-ce6d3fd5-3de7-4285-88d2-b3c74f33d768 req-49bf6615-0e2e-49d5-8d72-fa418a601fa3 service nova] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-ce6d3fd5-3de7-4285-88d2-b3c74f33d768 req-49bf6615-0e2e-49d5-8d72-fa418a601fa3 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] No waiting events found dispatching network-vif-unplugged-5b676148-29d7-4361-8205-c50f71a8eb6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-ce6d3fd5-3de7-4285-88d2-b3c74f33d768 req-49bf6615-0e2e-49d5-8d72-fa418a601fa3 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Received event network-vif-unplugged-5b676148-29d7-4361-8205-c50f71a8eb6d for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:49 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Instance destroyed successfully.
Apr 11 22:16:49 user nova-compute[71364]: DEBUG nova.objects.instance [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lazy-loading 'resources' on Instance uuid becdfdba-6e2f-48c1-bbe2-0db2c72e276c {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-327013399',display_name='tempest-TestVolumeBootPattern-server-327013399',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-327013399',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:15:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-g64vay1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:15:14Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=becdfdba-6e2f-48c1-bbe2-0db2c72e276c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b676148-29d7-4361-8205-c50f71a8eb6d", "address": "fa:16:3e:78:4e:de", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b676148-29", "ovs_interfaceid": "5b676148-29d7-4361-8205-c50f71a8eb6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "5b676148-29d7-4361-8205-c50f71a8eb6d", "address": "fa:16:3e:78:4e:de", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b676148-29", "ovs_interfaceid": "5b676148-29d7-4361-8205-c50f71a8eb6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=5b676148-29d7-4361-8205-c50f71a8eb6d,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b676148-29') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG os_vif [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=5b676148-29d7-4361-8205-c50f71a8eb6d,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b676148-29') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b676148-29, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:49 user nova-compute[71364]: INFO os_vif [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=5b676148-29d7-4361-8205-c50f71a8eb6d,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b676148-29')
Apr 11 22:16:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NbGidjuZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:16:49 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:16:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a8c742-98f8-46ec-8aea-a9023359301b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:16:49 user nova-compute[71364]: No targets found.
Apr 11 22:16:49 user nova-compute[71364]: iSNS:
Apr 11 22:16:49 user nova-compute[71364]: No targets found.
Apr 11 22:16:49 user nova-compute[71364]: STATIC:
Apr 11 22:16:49 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607
Apr 11 22:16:49 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:16:49 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:16:49 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2
Apr 11 22:16:49 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:16:49 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:16:49 user nova-compute[71364]: FIRMWARE:
Apr 11 22:16:49 user nova-compute[71364]: No targets found.
Apr 11 22:16:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:16:49 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:16:49 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[788a3423-b653-4f0c-990f-3605eff82a3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8851e2c-e387-46a9-8e67-d5a7c63c61cf]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:16:49 user nova-compute[71364]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)
Apr 11 22:16:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 (non-flash)
Apr 11 22:16:49 user nova-compute[71364]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)
Apr 11 22:16:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacf911b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e348ee01-9909-4d1f-865d-8cff5f8a75fe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[631d70c2-2ed6-4cb0-a145-34459371a5c5]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12fe6cc-9978-4697-a80f-0b49ac219da5]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1ced27-8f27-48af-a379-edeb090fd17e]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd6a199a9-e83e072989c7f784', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d6a199a9', '/dev/disk/by-id/scsi-26538336530373239') {{(pid=81576) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b055ab-4939-44c7-a342-7804941177a8]: (4, None) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33290ac-8e0e-448e-8074-aa081c1536dd]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9011c30-948b-4435-84d9-bbe4e29fc4e1]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607, portal: 172.16.0.220,3260]
Apr 11 22:16:50 user nova-compute[71364]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607, portal: 172.16.0.220,3260] successful.
Apr 11 22:16:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[91912954-edaf-4c7e-a05e-968c1610e619]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== disconnect_volume: return (320ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:16:50 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Deleting instance files /opt/stack/data/nova/instances/becdfdba-6e2f-48c1-bbe2-0db2c72e276c_del
Apr 11 22:16:50 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Deletion of /opt/stack/data/nova/instances/becdfdba-6e2f-48c1-bbe2-0db2c72e276c_del complete
Apr 11 22:16:50 user nova-compute[71364]: INFO nova.compute.manager [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 11 22:16:50 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:16:50 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:16:50 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Took 0.41 seconds to deallocate network for instance.
Apr 11 22:16:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-c83f4d65-9cbb-4119-b38b-237b93a658fd req-d9290d0d-7e18-46c8-8c82-ad873a516aab service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Received event network-vif-deleted-5b676148-29d7-4361-8205-c50f71a8eb6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:16:51 user nova-compute[71364]: INFO nova.compute.manager [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Took 0.77 seconds to detach 1 volumes for instance.
Apr 11 22:16:51 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Deleting volume: d9af431d-b2f3-4dcb-ab71-8fd5a0daf607 {{(pid=71364) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 22:16:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-b7cc04ae-f2dd-459a-ae5c-1a2fd0905d58 req-c23c835e-9871-49f3-b433-b8a8c8592b34 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Received event network-vif-plugged-5b676148-29d7-4361-8205-c50f71a8eb6d {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:16:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b7cc04ae-f2dd-459a-ae5c-1a2fd0905d58 req-c23c835e-9871-49f3-b433-b8a8c8592b34 service nova] Acquiring lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b7cc04ae-f2dd-459a-ae5c-1a2fd0905d58 req-c23c835e-9871-49f3-b433-b8a8c8592b34 service nova] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b7cc04ae-f2dd-459a-ae5c-1a2fd0905d58 req-c23c835e-9871-49f3-b433-b8a8c8592b34 service nova] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-b7cc04ae-f2dd-459a-ae5c-1a2fd0905d58 req-c23c835e-9871-49f3-b433-b8a8c8592b34 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] No waiting events found dispatching network-vif-plugged-5b676148-29d7-4361-8205-c50f71a8eb6d {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:16:51 user nova-compute[71364]: WARNING nova.compute.manager [req-b7cc04ae-f2dd-459a-ae5c-1a2fd0905d58 req-c23c835e-9871-49f3-b433-b8a8c8592b34 service nova] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Received unexpected event network-vif-plugged-5b676148-29d7-4361-8205-c50f71a8eb6d for instance with vm_state active and task_state deleting.
Apr 11 22:16:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:16:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:16:51 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:16:51 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:16:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:51 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Deleted allocations for instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c
Apr 11 22:16:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "becdfdba-6e2f-48c1-bbe2-0db2c72e276c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.796s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:16:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:16:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:17:04 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251409.8143961, becdfdba-6e2f-48c1-bbe2-0db2c72e276c => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:17:04 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] VM Stopped (Lifecycle Event)
Apr 11 22:17:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-b1835467-57c7-470b-b90f-4674bae92f13 None None] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:17:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:17:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:17:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:17:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:17:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:17:07 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:17:07 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:17:07 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8682MB free_disk=26.204830169677734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3331e482-bd81-47da-9e66-eade6dd2edcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:17:07 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:17:08 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:17:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:17:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:13 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:17:14 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:17:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:15 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:17:15 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:17:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:16 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:17:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:17:17 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:17:17 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:17:17 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 22:17:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:17:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:17:17 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:17:17 user nova-compute[71364]: DEBUG nova.objects.instance [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lazy-loading 'info_cache' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:17:17 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updating instance_info_cache with network_info: [{"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:17:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:17:17 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:17:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:20 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:17:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:25 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "c606772c-d1ed-415e-84f4-129319bb3865" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:17:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:28 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:17:28 user nova-compute[71364]: INFO nova.compute.claims [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Claim successful on node user
Apr 11 22:17:28 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:17:28 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.201s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG nova.network.neutron [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:17:29 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:17:29 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG nova.policy [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:17:29 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Creating image(s)
Apr 11 22:17:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "/opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "/opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "/opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "a144ea60a6de8246c688997a205bb18c14c2be59" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a144ea60a6de8246c688997a205bb18c14c2be59" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59.part --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59.part --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG nova.virt.images [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4 was qcow2, converting to raw {{(pid=71364) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59.part /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59.converted {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG nova.network.neutron [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Successfully created port: 3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59.part /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59.converted" returned: 0 in 0.169s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59.converted --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a144ea60a6de8246c688997a205bb18c14c2be59" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.817s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59 --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "a144ea60a6de8246c688997a205bb18c14c2be59" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a144ea60a6de8246c688997a205bb18c14c2be59" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59 --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59,backing_fmt=raw /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59,backing_fmt=raw /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk 1073741824" returned: 0 in 0.054s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a144ea60a6de8246c688997a205bb18c14c2be59" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.network.neutron [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Successfully updated port: 3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquired lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.network.neutron [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59 --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.network.neutron [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-b56a6f1d-37e8-4193-946d-324ed10eb01f req-5e78ad3e-1329-4541-ba68-30628a8a98ca service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-changed-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-b56a6f1d-37e8-4193-946d-324ed10eb01f req-5e78ad3e-1329-4541-ba68-30628a8a98ca service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Refreshing instance network info cache due to event network-changed-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b56a6f1d-37e8-4193-946d-324ed10eb01f req-5e78ad3e-1329-4541-ba68-30628a8a98ca service nova] Acquiring lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Cannot resize image /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.objects.instance [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'migration_context' on Instance uuid c606772c-d1ed-415e-84f4-129319bb3865 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Ensure instance console log exists: /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.network.neutron [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updating instance_info_cache with network_info: [{"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Releasing lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Instance network_info: |[{"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b56a6f1d-37e8-4193-946d-324ed10eb01f req-5e78ad3e-1329-4541-ba68-30628a8a98ca service nova] Acquired lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.network.neutron [req-b56a6f1d-37e8-4193-946d-324ed10eb01f req-5e78ad3e-1329-4541-ba68-30628a8a98ca service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Refreshing network info cache for port 3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Start _get_guest_xml network_info=[{"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T22:17:26Z,direct_url=<?>,disk_format='qcow2',id=13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4,min_disk=0,min_ram=0,name='tempest-scenario-img--269677564',owner='8c29da1948d84b08acbb7893db590608',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T22:17:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': '13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:17:30 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:17:30 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T22:17:26Z,direct_url=<?>,disk_format='qcow2',id=13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4,min_disk=0,min_ram=0,name='tempest-scenario-img--269677564',owner='8c29da1948d84b08acbb7893db590608',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T22:17:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-607364897',display_name='tempest-TestMinimumBasicScenario-server-607364897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-607364897',id=40,image_ref='13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0E6IW8IC9c9o4usL7v07yI/kkM/pJZNoOtLq6Y9s00xPpXz5e2WgJ8kun4/vc867GqTIrNUz+IIntx6J933ixpIdIU86aX7qU0WxlLh+Lwh+w1WRuI+adzdp2SaCNM3Q==',key_name='tempest-TestMinimumBasicScenario-2097245857',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c29da1948d84b08acbb7893db590608',ramdisk_id='',reservation_id='r-0xdd1no4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1414513068',owner_user_name='tempest-TestMinimumBasicScenario-1414513068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:17:29Z,user_data=None,user_id='e0e3f97050c448deba7ed9dbe0657c77',uuid=c606772c-d1ed-415e-84f4-129319bb3865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converting VIF {"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:11:ea,bridge_name='br-int',has_traffic_filtering=True,id=3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae4d6b9-6e') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.objects.instance [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'pci_devices' on Instance uuid c606772c-d1ed-415e-84f4-129319bb3865 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:17:30 user nova-compute[71364]:   <uuid>c606772c-d1ed-415e-84f4-129319bb3865</uuid>
Apr 11 22:17:30 user nova-compute[71364]:   <name>instance-00000028</name>
Apr 11 22:17:30 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:17:30 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:17:30 user nova-compute[71364]:   <metadata>
Apr 11 22:17:30 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:17:30 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:17:30 user nova-compute[71364]:       <nova:name>tempest-TestMinimumBasicScenario-server-607364897</nova:name>
Apr 11 22:17:30 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:17:30</nova:creationTime>
Apr 11 22:17:30 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:17:30 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:17:30 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:17:30 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:17:30 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:17:30 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:17:30 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:17:30 user nova-compute[71364]:       <nova:owner>
Apr 11 22:17:30 user nova-compute[71364]:         <nova:user uuid="e0e3f97050c448deba7ed9dbe0657c77">tempest-TestMinimumBasicScenario-1414513068-project-member</nova:user>
Apr 11 22:17:30 user nova-compute[71364]:         <nova:project uuid="8c29da1948d84b08acbb7893db590608">tempest-TestMinimumBasicScenario-1414513068</nova:project>
Apr 11 22:17:30 user nova-compute[71364]:       </nova:owner>
Apr 11 22:17:30 user nova-compute[71364]:       <nova:root type="image" uuid="13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4"/>
Apr 11 22:17:30 user nova-compute[71364]:       <nova:ports>
Apr 11 22:17:30 user nova-compute[71364]:         <nova:port uuid="3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3">
Apr 11 22:17:30 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 22:17:30 user nova-compute[71364]:         </nova:port>
Apr 11 22:17:30 user nova-compute[71364]:       </nova:ports>
Apr 11 22:17:30 user nova-compute[71364]:     </nova:instance>
Apr 11 22:17:30 user nova-compute[71364]:   </metadata>
Apr 11 22:17:30 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:17:30 user nova-compute[71364]:     <system>
Apr 11 22:17:30 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:17:30 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:17:30 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:17:30 user nova-compute[71364]:       <entry name="serial">c606772c-d1ed-415e-84f4-129319bb3865</entry>
Apr 11 22:17:30 user nova-compute[71364]:       <entry name="uuid">c606772c-d1ed-415e-84f4-129319bb3865</entry>
Apr 11 22:17:30 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:17:30 user nova-compute[71364]:     </system>
Apr 11 22:17:30 user nova-compute[71364]:   </sysinfo>
Apr 11 22:17:30 user nova-compute[71364]:   <os>
Apr 11 22:17:30 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:17:30 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:17:30 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:17:30 user nova-compute[71364]:   </os>
Apr 11 22:17:30 user nova-compute[71364]:   <features>
Apr 11 22:17:30 user nova-compute[71364]:     <acpi/>
Apr 11 22:17:30 user nova-compute[71364]:     <apic/>
Apr 11 22:17:30 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:17:30 user nova-compute[71364]:   </features>
Apr 11 22:17:30 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:17:30 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:17:30 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:17:30 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:17:30 user nova-compute[71364]:   </clock>
Apr 11 22:17:30 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:17:30 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:17:30 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:17:30 user nova-compute[71364]:   </cpu>
Apr 11 22:17:30 user nova-compute[71364]:   <devices>
Apr 11 22:17:30 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:17:30 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:17:30 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk"/>
Apr 11 22:17:30 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:17:30 user nova-compute[71364]:     </disk>
Apr 11 22:17:30 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:17:30 user nova-compute[71364]:       <mac address="fa:16:3e:8b:11:ea"/>
Apr 11 22:17:30 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:17:30 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:17:30 user nova-compute[71364]:       <target dev="tap3ae4d6b9-6e"/>
Apr 11 22:17:30 user nova-compute[71364]:     </interface>
Apr 11 22:17:30 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:17:30 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/console.log" append="off"/>
Apr 11 22:17:30 user nova-compute[71364]:     </serial>
Apr 11 22:17:30 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:17:30 user nova-compute[71364]:     <video>
Apr 11 22:17:30 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:17:30 user nova-compute[71364]:     </video>
Apr 11 22:17:30 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:17:30 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:17:30 user nova-compute[71364]:     </rng>
Apr 11 22:17:30 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:17:30 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:17:30 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:17:30 user nova-compute[71364]:     </memballoon>
Apr 11 22:17:30 user nova-compute[71364]:   </devices>
Apr 11 22:17:30 user nova-compute[71364]: </domain>
Apr 11 22:17:30 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-607364897',display_name='tempest-TestMinimumBasicScenario-server-607364897',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-607364897',id=40,image_ref='13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0E6IW8IC9c9o4usL7v07yI/kkM/pJZNoOtLq6Y9s00xPpXz5e2WgJ8kun4/vc867GqTIrNUz+IIntx6J933ixpIdIU86aX7qU0WxlLh+Lwh+w1WRuI+adzdp2SaCNM3Q==',key_name='tempest-TestMinimumBasicScenario-2097245857',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c29da1948d84b08acbb7893db590608',ramdisk_id='',reservation_id='r-0xdd1no4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1414513068',owner_user_name='tempest-TestMinimumBasicScenario-1414513068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:17:29Z,user_data=None,user_id='e0e3f97050c448deba7ed9dbe0657c77',uuid=c606772c-d1ed-415e-84f4-129319bb3865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converting VIF {"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:11:ea,bridge_name='br-int',has_traffic_filtering=True,id=3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae4d6b9-6e') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG os_vif [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:11:ea,bridge_name='br-int',has_traffic_filtering=True,id=3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae4d6b9-6e') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ae4d6b9-6e, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ae4d6b9-6e, col_values=(('external_ids', {'iface-id': '3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:11:ea', 'vm-uuid': 'c606772c-d1ed-415e-84f4-129319bb3865'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:17:30 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:17:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:31 user nova-compute[71364]: INFO os_vif [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:11:ea,bridge_name='br-int',has_traffic_filtering=True,id=3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae4d6b9-6e')
Apr 11 22:17:31 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:17:31 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] No VIF found with MAC fa:16:3e:8b:11:ea, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:17:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-b56a6f1d-37e8-4193-946d-324ed10eb01f req-5e78ad3e-1329-4541-ba68-30628a8a98ca service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updated VIF entry in instance network info cache for port 3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:17:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-b56a6f1d-37e8-4193-946d-324ed10eb01f req-5e78ad3e-1329-4541-ba68-30628a8a98ca service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updating instance_info_cache with network_info: [{"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:17:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b56a6f1d-37e8-4193-946d-324ed10eb01f req-5e78ad3e-1329-4541-ba68-30628a8a98ca service nova] Releasing lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:17:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-0a23828e-60ef-4072-b35d-adca83818317 req-5166786a-56fa-4727-97b3-6f56a6d867be service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:17:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0a23828e-60ef-4072-b35d-adca83818317 req-5166786a-56fa-4727-97b3-6f56a6d867be service nova] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0a23828e-60ef-4072-b35d-adca83818317 req-5166786a-56fa-4727-97b3-6f56a6d867be service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0a23828e-60ef-4072-b35d-adca83818317 req-5166786a-56fa-4727-97b3-6f56a6d867be service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-0a23828e-60ef-4072-b35d-adca83818317 req-5166786a-56fa-4727-97b3-6f56a6d867be service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] No waiting events found dispatching network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:17:32 user nova-compute[71364]: WARNING nova.compute.manager [req-0a23828e-60ef-4072-b35d-adca83818317 req-5166786a-56fa-4727-97b3-6f56a6d867be service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received unexpected event network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance with vm_state building and task_state spawning.
Apr 11 22:17:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251454.4917934, c606772c-d1ed-415e-84f4-129319bb3865 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:17:34 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] VM Resumed (Lifecycle Event)
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:17:34 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Instance spawned successfully.
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:17:34 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251454.492913, c606772c-d1ed-415e-84f4-129319bb3865 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:17:34 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] VM Started (Lifecycle Event)
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:17:34 user nova-compute[71364]: INFO nova.compute.manager [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Took 5.34 seconds to spawn the instance on the hypervisor.
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:17:34 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:17:34 user nova-compute[71364]: INFO nova.compute.manager [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Took 5.89 seconds to build instance.
Apr 11 22:17:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "c606772c-d1ed-415e-84f4-129319bb3865" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.977s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.compute.manager [req-545957ee-756f-45fb-932d-3c371ca70e41 req-b7904550-83f9-4e37-9ad2-789892b08fdf service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-545957ee-756f-45fb-932d-3c371ca70e41 req-b7904550-83f9-4e37-9ad2-789892b08fdf service nova] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-545957ee-756f-45fb-932d-3c371ca70e41 req-b7904550-83f9-4e37-9ad2-789892b08fdf service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-545957ee-756f-45fb-932d-3c371ca70e41 req-b7904550-83f9-4e37-9ad2-789892b08fdf service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:34 user nova-compute[71364]: DEBUG nova.compute.manager [req-545957ee-756f-45fb-932d-3c371ca70e41 req-b7904550-83f9-4e37-9ad2-789892b08fdf service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] No waiting events found dispatching network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:17:34 user nova-compute[71364]: WARNING nova.compute.manager [req-545957ee-756f-45fb-932d-3c371ca70e41 req-b7904550-83f9-4e37-9ad2-789892b08fdf service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received unexpected event network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance with vm_state active and task_state None.
Apr 11 22:17:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "6c682755-7a09-4872-8be2-c429ced2debe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "6c682755-7a09-4872-8be2-c429ced2debe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:17:44 user nova-compute[71364]: INFO nova.compute.claims [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Claim successful on node user
Apr 11 22:17:44 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:17:44 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:17:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:17:44 user nova-compute[71364]: INFO nova.virt.block_device [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Booting with volume d835ec35-c1e9-466e-a602-8e96296dd758 at /dev/vda
Apr 11 22:17:44 user nova-compute[71364]: DEBUG nova.policy [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG os_brick.utils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad70851-e648-4f88-97ac-2aa80f5de061]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0089ef-01e0-4219-90eb-1c4f1e33c789]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bdf4df-ead7-4bdc-b961-bc25a11b9757]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45a3a27-00ab-4ef0-91b1-c3a164bdef42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:17:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:17:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:45 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:17:45 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:17:45 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c649ef-6826-4b75-9a9b-91a59b177feb]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:17:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:17:45 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:17:45 user nova-compute[71364]: DEBUG os_brick.utils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:17:45 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Updating existing volume attachment record: 99e7f05a-cc9c-4146-8353-3a18cafd7f03 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:17:45 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Successfully created port: b7d928c8-122d-48cb-a4e1-916a12301d5b {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:17:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:17:46 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Successfully updated port: b7d928c8-122d-48cb-a4e1-916a12301d5b {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:17:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "refresh_cache-6c682755-7a09-4872-8be2-c429ced2debe" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:17:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquired lock "refresh_cache-6c682755-7a09-4872-8be2-c429ced2debe" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:17:46 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:17:46 user nova-compute[71364]: DEBUG nova.compute.manager [req-fbd2d0ac-c40c-4dbd-a37e-6df9cfededbc req-df319a9c-2127-4a96-b53f-265413446b18 service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Received event network-changed-b7d928c8-122d-48cb-a4e1-916a12301d5b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:17:46 user nova-compute[71364]: DEBUG nova.compute.manager [req-fbd2d0ac-c40c-4dbd-a37e-6df9cfededbc req-df319a9c-2127-4a96-b53f-265413446b18 service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Refreshing instance network info cache due to event network-changed-b7d928c8-122d-48cb-a4e1-916a12301d5b. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:17:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fbd2d0ac-c40c-4dbd-a37e-6df9cfededbc req-df319a9c-2127-4a96-b53f-265413446b18 service nova] Acquiring lock "refresh_cache-6c682755-7a09-4872-8be2-c429ced2debe" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:17:46 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:17:46 user nova-compute[71364]: DEBUG nova.network.neutron [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Updating instance_info_cache with network_info: [{"id": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "address": "fa:16:3e:22:7a:fd", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d928c8-12", "ovs_interfaceid": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:17:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Releasing lock "refresh_cache-6c682755-7a09-4872-8be2-c429ced2debe" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:17:46 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Instance network_info: |[{"id": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "address": "fa:16:3e:22:7a:fd", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d928c8-12", "ovs_interfaceid": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:17:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fbd2d0ac-c40c-4dbd-a37e-6df9cfededbc req-df319a9c-2127-4a96-b53f-265413446b18 service nova] Acquired lock "refresh_cache-6c682755-7a09-4872-8be2-c429ced2debe" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:17:46 user nova-compute[71364]: DEBUG nova.network.neutron [req-fbd2d0ac-c40c-4dbd-a37e-6df9cfededbc req-df319a9c-2127-4a96-b53f-265413446b18 service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Refreshing network info cache for port b7d928c8-122d-48cb-a4e1-916a12301d5b {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:17:47 user nova-compute[71364]: DEBUG nova.network.neutron [req-fbd2d0ac-c40c-4dbd-a37e-6df9cfededbc req-df319a9c-2127-4a96-b53f-265413446b18 service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Updated VIF entry in instance network info cache for port b7d928c8-122d-48cb-a4e1-916a12301d5b. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:17:47 user nova-compute[71364]: DEBUG nova.network.neutron [req-fbd2d0ac-c40c-4dbd-a37e-6df9cfededbc req-df319a9c-2127-4a96-b53f-265413446b18 service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Updating instance_info_cache with network_info: [{"id": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "address": "fa:16:3e:22:7a:fd", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d928c8-12", "ovs_interfaceid": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:17:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fbd2d0ac-c40c-4dbd-a37e-6df9cfededbc req-df319a9c-2127-4a96-b53f-265413446b18 service nova] Releasing lock "refresh_cache-6c682755-7a09-4872-8be2-c429ced2debe" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:17:49 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Creating image(s)
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Ensure instance console log exists: /opt/stack/data/nova/instances/6c682755-7a09-4872-8be2-c429ced2debe/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Start _get_guest_xml network_info=[{"id": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "address": "fa:16:3e:22:7a:fd", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d928c8-12", "ovs_interfaceid": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtAkshSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6c682755-7a09-4872-8be2-c429ced2debe', 'attached_at': '', 'detached_at': '', 'volume_id': 'd835ec35-c1e9-466e-a602-8e96296dd758', 'serial': 'd835ec35-c1e9-466e-a602-8e96296dd758'}, 'attachment_id': '99e7f05a-cc9c-4146-8353-3a18cafd7f03', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:17:49 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:17:49 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtAkshSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:17:49 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:17:49 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:17:49 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab64bb4-8167-4992-8ec6-b4560e75186b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:17:49 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0dabc7-6e47-47ee-a383-071800bd343f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758] added
Apr 11 22:17:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.122s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c1d72-ecdb-45ba-be1f-946f217e745b]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3747d3-1229-4170-bf6b-4c234f96f324]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JtAkshSG {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JtAkshSG" returned: 0 in 0.036s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed87c04c-b83d-4248-a07d-39e8812d8c93]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JtAkshSG'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[394b17bc-c48b-45e8-92db-93448a9fe7b5]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[46253c92-ac94-467b-b873-d83623323a85]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)
Apr 11 22:17:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)
Apr 11 22:17:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e45de0-3e28-45b1-9f08-ea44ae97e64f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758, portal: 172.16.0.220,3260]
Apr 11 22:17:49 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758, portal: 172.16.0.220,3260] successful.
Apr 11 22:17:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f26f6e-8e92-4cba-a4b9-a811489c8e46]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1dc979-53bc-40d7-9827-b338c37d1c64]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)
Apr 11 22:17:49 user nova-compute[71364]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:17:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)
Apr 11 22:17:49 user nova-compute[71364]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:17:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a38df01-fb5a-4833-b9b3-b7a057e8e9b3]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:17:49 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:17:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:17:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtAkshSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:17:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:17:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== connect_volume: return (1477ms) {'type': 'block', 'scsi_wwn': '23934323335333763', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:17:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934323335333763', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:17:50 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1471432587',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1471432587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1471432587',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-86scabjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:17:45Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=6c682755-7a09-4872-8be2-c429ced2debe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "address": "fa:16:3e:22:7a:fd", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d928c8-12", "ovs_interfaceid": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:17:50 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "address": "fa:16:3e:22:7a:fd", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d928c8-12", "ovs_interfaceid": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:7a:fd,bridge_name='br-int',has_traffic_filtering=True,id=b7d928c8-122d-48cb-a4e1-916a12301d5b,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d928c8-12') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG nova.objects.instance [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c682755-7a09-4872-8be2-c429ced2debe {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:17:51 user nova-compute[71364]:   <uuid>6c682755-7a09-4872-8be2-c429ced2debe</uuid>
Apr 11 22:17:51 user nova-compute[71364]:   <name>instance-00000029</name>
Apr 11 22:17:51 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:17:51 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:17:51 user nova-compute[71364]:   <metadata>
Apr 11 22:17:51 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:17:51 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:17:51 user nova-compute[71364]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1471432587</nova:name>
Apr 11 22:17:51 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:17:49</nova:creationTime>
Apr 11 22:17:51 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:17:51 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:17:51 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:17:51 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:17:51 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:17:51 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:17:51 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:17:51 user nova-compute[71364]:       <nova:owner>
Apr 11 22:17:51 user nova-compute[71364]:         <nova:user uuid="4fdb893b6ea3402788a89740355fa935">tempest-TestVolumeBootPattern-1208917682-project-member</nova:user>
Apr 11 22:17:51 user nova-compute[71364]:         <nova:project uuid="eb843e213c594ac28f864550ad68833b">tempest-TestVolumeBootPattern-1208917682</nova:project>
Apr 11 22:17:51 user nova-compute[71364]:       </nova:owner>
Apr 11 22:17:51 user nova-compute[71364]:       <nova:ports>
Apr 11 22:17:51 user nova-compute[71364]:         <nova:port uuid="b7d928c8-122d-48cb-a4e1-916a12301d5b">
Apr 11 22:17:51 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 22:17:51 user nova-compute[71364]:         </nova:port>
Apr 11 22:17:51 user nova-compute[71364]:       </nova:ports>
Apr 11 22:17:51 user nova-compute[71364]:     </nova:instance>
Apr 11 22:17:51 user nova-compute[71364]:   </metadata>
Apr 11 22:17:51 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:17:51 user nova-compute[71364]:     <system>
Apr 11 22:17:51 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:17:51 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:17:51 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:17:51 user nova-compute[71364]:       <entry name="serial">6c682755-7a09-4872-8be2-c429ced2debe</entry>
Apr 11 22:17:51 user nova-compute[71364]:       <entry name="uuid">6c682755-7a09-4872-8be2-c429ced2debe</entry>
Apr 11 22:17:51 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:17:51 user nova-compute[71364]:     </system>
Apr 11 22:17:51 user nova-compute[71364]:   </sysinfo>
Apr 11 22:17:51 user nova-compute[71364]:   <os>
Apr 11 22:17:51 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:17:51 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:17:51 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:17:51 user nova-compute[71364]:   </os>
Apr 11 22:17:51 user nova-compute[71364]:   <features>
Apr 11 22:17:51 user nova-compute[71364]:     <acpi/>
Apr 11 22:17:51 user nova-compute[71364]:     <apic/>
Apr 11 22:17:51 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:17:51 user nova-compute[71364]:   </features>
Apr 11 22:17:51 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:17:51 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:17:51 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:17:51 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:17:51 user nova-compute[71364]:   </clock>
Apr 11 22:17:51 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:17:51 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:17:51 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:17:51 user nova-compute[71364]:   </cpu>
Apr 11 22:17:51 user nova-compute[71364]:   <devices>
Apr 11 22:17:51 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 22:17:51 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:17:51 user nova-compute[71364]:       <source dev="/dev/sdb"/>
Apr 11 22:17:51 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:17:51 user nova-compute[71364]:       <serial>d835ec35-c1e9-466e-a602-8e96296dd758</serial>
Apr 11 22:17:51 user nova-compute[71364]:     </disk>
Apr 11 22:17:51 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:17:51 user nova-compute[71364]:       <mac address="fa:16:3e:22:7a:fd"/>
Apr 11 22:17:51 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:17:51 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:17:51 user nova-compute[71364]:       <target dev="tapb7d928c8-12"/>
Apr 11 22:17:51 user nova-compute[71364]:     </interface>
Apr 11 22:17:51 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:17:51 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/6c682755-7a09-4872-8be2-c429ced2debe/console.log" append="off"/>
Apr 11 22:17:51 user nova-compute[71364]:     </serial>
Apr 11 22:17:51 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:17:51 user nova-compute[71364]:     <video>
Apr 11 22:17:51 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:17:51 user nova-compute[71364]:     </video>
Apr 11 22:17:51 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:17:51 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:17:51 user nova-compute[71364]:     </rng>
Apr 11 22:17:51 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:17:51 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:17:51 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:17:51 user nova-compute[71364]:     </memballoon>
Apr 11 22:17:51 user nova-compute[71364]:   </devices>
Apr 11 22:17:51 user nova-compute[71364]: </domain>
Apr 11 22:17:51 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1471432587',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1471432587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1471432587',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-86scabjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:17:45Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=6c682755-7a09-4872-8be2-c429ced2debe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "address": "fa:16:3e:22:7a:fd", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d928c8-12", "ovs_interfaceid": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "address": "fa:16:3e:22:7a:fd", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d928c8-12", "ovs_interfaceid": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:7a:fd,bridge_name='br-int',has_traffic_filtering=True,id=b7d928c8-122d-48cb-a4e1-916a12301d5b,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d928c8-12') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG os_vif [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:7a:fd,bridge_name='br-int',has_traffic_filtering=True,id=b7d928c8-122d-48cb-a4e1-916a12301d5b,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d928c8-12') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7d928c8-12, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7d928c8-12, col_values=(('external_ids', {'iface-id': 'b7d928c8-122d-48cb-a4e1-916a12301d5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:7a:fd', 'vm-uuid': '6c682755-7a09-4872-8be2-c429ced2debe'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:51 user nova-compute[71364]: INFO os_vif [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:7a:fd,bridge_name='br-int',has_traffic_filtering=True,id=b7d928c8-122d-48cb-a4e1-916a12301d5b,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d928c8-12')
Apr 11 22:17:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:17:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] No VIF found with MAC fa:16:3e:22:7a:fd, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:17:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-fedf9c6d-d54e-4b88-b010-b85cc5a19e46 req-436e9ce1-c481-4561-a838-99557db7dfb9 service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Received event network-vif-plugged-b7d928c8-122d-48cb-a4e1-916a12301d5b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:17:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fedf9c6d-d54e-4b88-b010-b85cc5a19e46 req-436e9ce1-c481-4561-a838-99557db7dfb9 service nova] Acquiring lock "6c682755-7a09-4872-8be2-c429ced2debe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fedf9c6d-d54e-4b88-b010-b85cc5a19e46 req-436e9ce1-c481-4561-a838-99557db7dfb9 service nova] Lock "6c682755-7a09-4872-8be2-c429ced2debe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fedf9c6d-d54e-4b88-b010-b85cc5a19e46 req-436e9ce1-c481-4561-a838-99557db7dfb9 service nova] Lock "6c682755-7a09-4872-8be2-c429ced2debe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-fedf9c6d-d54e-4b88-b010-b85cc5a19e46 req-436e9ce1-c481-4561-a838-99557db7dfb9 service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] No waiting events found dispatching network-vif-plugged-b7d928c8-122d-48cb-a4e1-916a12301d5b {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:17:52 user nova-compute[71364]: WARNING nova.compute.manager [req-fedf9c6d-d54e-4b88-b010-b85cc5a19e46 req-436e9ce1-c481-4561-a838-99557db7dfb9 service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Received unexpected event network-vif-plugged-b7d928c8-122d-48cb-a4e1-916a12301d5b for instance with vm_state building and task_state spawning.
Apr 11 22:17:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251474.4393063, 6c682755-7a09-4872-8be2-c429ced2debe => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:17:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] VM Resumed (Lifecycle Event)
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:17:54 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Instance spawned successfully.
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:17:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251474.442586, 6c682755-7a09-4872-8be2-c429ced2debe => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:17:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] VM Started (Lifecycle Event)
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:17:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:17:54 user nova-compute[71364]: INFO nova.compute.manager [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Took 5.13 seconds to spawn the instance on the hypervisor.
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-7a2ce69d-daf2-4599-9d6c-4a1eda0e6171 req-6cf41735-abd8-4558-9d26-2c9113b51914 service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Received event network-vif-plugged-b7d928c8-122d-48cb-a4e1-916a12301d5b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7a2ce69d-daf2-4599-9d6c-4a1eda0e6171 req-6cf41735-abd8-4558-9d26-2c9113b51914 service nova] Acquiring lock "6c682755-7a09-4872-8be2-c429ced2debe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7a2ce69d-daf2-4599-9d6c-4a1eda0e6171 req-6cf41735-abd8-4558-9d26-2c9113b51914 service nova] Lock "6c682755-7a09-4872-8be2-c429ced2debe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7a2ce69d-daf2-4599-9d6c-4a1eda0e6171 req-6cf41735-abd8-4558-9d26-2c9113b51914 service nova] Lock "6c682755-7a09-4872-8be2-c429ced2debe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-7a2ce69d-daf2-4599-9d6c-4a1eda0e6171 req-6cf41735-abd8-4558-9d26-2c9113b51914 service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] No waiting events found dispatching network-vif-plugged-b7d928c8-122d-48cb-a4e1-916a12301d5b {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:17:54 user nova-compute[71364]: WARNING nova.compute.manager [req-7a2ce69d-daf2-4599-9d6c-4a1eda0e6171 req-6cf41735-abd8-4558-9d26-2c9113b51914 service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Received unexpected event network-vif-plugged-b7d928c8-122d-48cb-a4e1-916a12301d5b for instance with vm_state building and task_state spawning.
Apr 11 22:17:54 user nova-compute[71364]: INFO nova.compute.manager [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Took 10.15 seconds to build instance.
Apr 11 22:17:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "6c682755-7a09-4872-8be2-c429ced2debe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.237s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:17:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:17:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:18:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:18:01 user nova-compute[71364]: INFO nova.compute.manager [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Detaching volume 327322e4-555d-4e26-aab2-635279b0cec2
Apr 11 22:18:01 user nova-compute[71364]: INFO nova.virt.block_device [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Attempting to driver detach volume 327322e4-555d-4e26-aab2-635279b0cec2 from mountpoint /dev/vdc
Apr 11 22:18:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Attempting to detach device vdc from instance 3331e482-bd81-47da-9e66-eade6dd2edcc from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:18:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:18:01 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:18:01 user nova-compute[71364]:   <source dev="/dev/sdc"/>
Apr 11 22:18:01 user nova-compute[71364]:   <target dev="vdc" bus="virtio"/>
Apr 11 22:18:01 user nova-compute[71364]:   <serial>327322e4-555d-4e26-aab2-635279b0cec2</serial>
Apr 11 22:18:01 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 22:18:01 user nova-compute[71364]: </disk>
Apr 11 22:18:01 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:18:01 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Successfully detached device vdc from instance 3331e482-bd81-47da-9e66-eade6dd2edcc from the persistent domain config.
Apr 11 22:18:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3331e482-bd81-47da-9e66-eade6dd2edcc from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:18:01 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:18:01 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:18:01 user nova-compute[71364]:   <source dev="/dev/sdc"/>
Apr 11 22:18:01 user nova-compute[71364]:   <target dev="vdc" bus="virtio"/>
Apr 11 22:18:01 user nova-compute[71364]:   <serial>327322e4-555d-4e26-aab2-635279b0cec2</serial>
Apr 11 22:18:01 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 22:18:01 user nova-compute[71364]: </disk>
Apr 11 22:18:01 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681251482.3731735, 3331e482-bd81-47da-9e66-eade6dd2edcc => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:18:02 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Successfully detached device vdc from instance 3331e482-bd81-47da-9e66-eade6dd2edcc from the live domain config.
Apr 11 22:18:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eSzDvYZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:18:02 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[db291a16-8d03-4946-aca2-462c1ca2abee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:18:02 user nova-compute[71364]: No targets found.
Apr 11 22:18:02 user nova-compute[71364]: iSNS:
Apr 11 22:18:02 user nova-compute[71364]: No targets found.
Apr 11 22:18:02 user nova-compute[71364]: STATIC:
Apr 11 22:18:02 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758
Apr 11 22:18:02 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:18:02 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:18:02 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2
Apr 11 22:18:02 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:18:02 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:18:02 user nova-compute[71364]: FIRMWARE:
Apr 11 22:18:02 user nova-compute[71364]: No targets found.
Apr 11 22:18:02 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:18:02 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:18:02 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa62407-e5dc-4c31-b9e9-16b6b1711d9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f697acd4-bd2e-4c47-bf57-bea66d6b3bbf]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)
Apr 11 22:18:02 user nova-compute[71364]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:18:02 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 (non-flash)
Apr 11 22:18:02 user nova-compute[71364]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:18:02 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bf0296830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2'): ({'sdc'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Removing single pathed devices sdc {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5575a1d0-6672-41e3-87cc-5f0e334df0d3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[256c2c86-752e-4f41-a34c-3c467ddf93d2]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Flushing IO for device /dev/sdc {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7f486e-54c7-452d-9e7f-edde0c834687]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[621ed559-e5e5-4ead-89cf-addd5fad36d5]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd11ef0-a6dc-41ae-83bc-e51800860ef0]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3452de18-b910-4982-8d0d-b2074aecb775]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2, portal: 172.16.0.220,3260]
Apr 11 22:18:02 user nova-compute[71364]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2, portal: 172.16.0.220,3260] successful.
Apr 11 22:18:02 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:327322e4-555d-4e26-aab2-635279b0cec2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ec95e4-9153-4fef-b9c3-98f4c3315880]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] <== disconnect_volume: return (291ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:18:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:18:03 user nova-compute[71364]: DEBUG nova.objects.instance [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'flavor' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:18:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.702s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:18:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:07 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:18:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:18:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:18:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:18:07 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:18:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:18:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:18:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:18:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:18:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:18:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:18:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:18:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:18:07 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:18:08 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:18:08 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:18:08 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8491MB free_disk=26.13458251953125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:18:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:18:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:18:08 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3331e482-bd81-47da-9e66-eade6dd2edcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:18:08 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c606772c-d1ed-415e-84f4-129319bb3865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:18:08 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 6c682755-7a09-4872-8be2-c429ced2debe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:18:08 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:18:08 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:18:08 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:18:08 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:18:08 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:18:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:18:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:18:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:14 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:18:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:15 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:18:15 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:18:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:17 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:18:18 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:18:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:18:19 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:18:19 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:18:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:18:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 22:18:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:18:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:18:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:18:19 user nova-compute[71364]: DEBUG nova.objects.instance [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lazy-loading 'info_cache' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:18:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updating instance_info_cache with network_info: [{"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:18:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-3331e482-bd81-47da-9e66-eade6dd2edcc" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:18:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:18:20 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:18:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:18:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:18:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:18:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:18:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:18:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:18:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:18:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:18:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:18:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:18:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:18:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:18:52 user nova-compute[71364]: INFO nova.compute.manager [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Terminating instance
Apr 11 22:18:52 user nova-compute[71364]: DEBUG nova.compute.manager [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-05ce3981-90a6-4c20-b9d8-98f201ff3b4e req-8a45accb-8027-4dd7-a179-0a154991b01a service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received event network-vif-unplugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-05ce3981-90a6-4c20-b9d8-98f201ff3b4e req-8a45accb-8027-4dd7-a179-0a154991b01a service nova] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-05ce3981-90a6-4c20-b9d8-98f201ff3b4e req-8a45accb-8027-4dd7-a179-0a154991b01a service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-05ce3981-90a6-4c20-b9d8-98f201ff3b4e req-8a45accb-8027-4dd7-a179-0a154991b01a service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-05ce3981-90a6-4c20-b9d8-98f201ff3b4e req-8a45accb-8027-4dd7-a179-0a154991b01a service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] No waiting events found dispatching network-vif-unplugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG nova.compute.manager [req-05ce3981-90a6-4c20-b9d8-98f201ff3b4e req-8a45accb-8027-4dd7-a179-0a154991b01a service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received event network-vif-unplugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:18:52 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Instance destroyed successfully.
Apr 11 22:18:52 user nova-compute[71364]: DEBUG nova.objects.instance [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'resources' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T22:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1059229540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1059229540',id=37,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMatx2BIJDvb1/qWBbpl5ESBBxq/iMRYOnc9wjSJgIdAqgjjdFvwNzCgMnXbgpSi0jypGAgU2YpKOIBtnQi+JlOyNHiSni3dJBuvkgEe7mmK3+ZRHrtLRf+cvKNcO+lE4g==',key_name='tempest-keypair-2035792703',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:16:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29e79d7c2e144af59f911973e79ba110',ramdisk_id='',reservation_id='r-f90giz2d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-590407943',owner_user_name='tempest-AttachVolumeShelveTestJSON-590407943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:16:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5898621881a4e799df121e1d5957f42',uuid=3331e482-bd81-47da-9e66-eade6dd2edcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converting VIF {"id": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "address": "fa:16:3e:da:31:e4", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca38ad-28", "ovs_interfaceid": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:31:e4,bridge_name='br-int',has_traffic_filtering=True,id=04ca38ad-28b6-4863-ad00-2d83b8d40fa9,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca38ad-28') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG os_vif [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:31:e4,bridge_name='br-int',has_traffic_filtering=True,id=04ca38ad-28b6-4863-ad00-2d83b8d40fa9,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca38ad-28') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04ca38ad-28, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:18:52 user nova-compute[71364]: INFO os_vif [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:31:e4,bridge_name='br-int',has_traffic_filtering=True,id=04ca38ad-28b6-4863-ad00-2d83b8d40fa9,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca38ad-28')
Apr 11 22:18:52 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Deleting instance files /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc_del
Apr 11 22:18:52 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Deletion of /opt/stack/data/nova/instances/3331e482-bd81-47da-9e66-eade6dd2edcc_del complete
Apr 11 22:18:53 user nova-compute[71364]: INFO nova.compute.manager [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 11 22:18:53 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:18:53 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:18:53 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:18:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:53 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:18:53 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Took 0.68 seconds to deallocate network for instance.
Apr 11 22:18:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-cee89f60-5382-4b8a-90b5-734db6e623ab req-83f7eafa-2392-44c8-a20d-398a18ec9a99 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received event network-vif-deleted-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:18:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:18:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:18:53 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:18:53 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:18:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:18:53 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Deleted allocations for instance 3331e482-bd81-47da-9e66-eade6dd2edcc
Apr 11 22:18:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.867s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:18:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-61cc90b3-d8d6-4e84-be1a-3eafef9ec14a req-9cd2bfff-e9d8-4066-a430-d12f4d151380 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received event network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:18:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-61cc90b3-d8d6-4e84-be1a-3eafef9ec14a req-9cd2bfff-e9d8-4066-a430-d12f4d151380 service nova] Acquiring lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:18:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-61cc90b3-d8d6-4e84-be1a-3eafef9ec14a req-9cd2bfff-e9d8-4066-a430-d12f4d151380 service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:18:54 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-61cc90b3-d8d6-4e84-be1a-3eafef9ec14a req-9cd2bfff-e9d8-4066-a430-d12f4d151380 service nova] Lock "3331e482-bd81-47da-9e66-eade6dd2edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:18:54 user nova-compute[71364]: DEBUG nova.compute.manager [req-61cc90b3-d8d6-4e84-be1a-3eafef9ec14a req-9cd2bfff-e9d8-4066-a430-d12f4d151380 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] No waiting events found dispatching network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:18:54 user nova-compute[71364]: WARNING nova.compute.manager [req-61cc90b3-d8d6-4e84-be1a-3eafef9ec14a req-9cd2bfff-e9d8-4066-a430-d12f4d151380 service nova] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Received unexpected event network-vif-plugged-04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance with vm_state deleted and task_state None.
Apr 11 22:18:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:18:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:19:07 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251532.9338615, 3331e482-bd81-47da-9e66-eade6dd2edcc => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:19:07 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] VM Stopped (Lifecycle Event)
Apr 11 22:19:07 user nova-compute[71364]: DEBUG nova.compute.manager [None req-15eb69c1-7fa1-4c68-ba2b-5cafbb1760ac None None] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:19:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:08 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:19:08 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:19:08 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8604MB free_disk=26.15351104736328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c606772c-d1ed-415e-84f4-129319bb3865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 6c682755-7a09-4872-8be2-c429ced2debe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:19:08 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:19:09 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:19:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:19:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:15 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:19:16 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:19:17 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:19:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:18 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:19:18 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:19:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:19:19 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:19:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:19:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:19:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:19:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:19:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updating instance_info_cache with network_info: [{"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:19:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:19:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:19:20 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "c606772c-d1ed-415e-84f4-129319bb3865" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'flavor' on Instance uuid c606772c-d1ed-415e-84f4-129319bb3865 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "c606772c-d1ed-415e-84f4-129319bb3865" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "c606772c-d1ed-415e-84f4-129319bb3865" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:21 user nova-compute[71364]: INFO nova.compute.manager [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Attaching volume 3124c49b-2f09-41c8-8965-a0e4266f053c to /dev/vdb
Apr 11 22:19:21 user nova-compute[71364]: DEBUG os_brick.utils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c914955-869e-4adc-ad06-f55ecea2b8e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[083b20f4-ad14-4d36-8c04-b1d92622778c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8301e695-cbf4-49c7-9a9c-3236ddab58ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0d4d23-5e9b-4976-bdcf-a5aa7f51525b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:19:21 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:19:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[38beb1df-0b9a-4b2a-9eee-29e4c24d3ded]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG os_brick.utils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:19:21 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updating existing volume attachment record: 2cd0ebd4-38f5-4255-8651-a28446694154 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:19:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRZMhypJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:19:25 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:19:25 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:19:25 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba26784-0130-4a9b-8e1b-9689f1070515]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:19:25 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3a7714-f853-4cde-9bdb-ea4b9fb3417b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c] added
Apr 11 22:19:25 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d69df6-9e41-46e8-829a-57d5b42ebb48]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c83031-5bc3-45c1-99d0-a7dab4e7533e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zRZMhypJ {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zRZMhypJ" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5e90aa-5d4d-4c12-ae5c-fb3d952c4033]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zRZMhypJ'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[260a6623-3f23-4474-a97f-674f22e879c0]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd57a02-da04-4d71-922d-161d7e3b28fd]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:19:25 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:19:25 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f44655b-e8b1-4409-8cd7-8f5c69f5818e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260]
Apr 11 22:19:25 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260] successful.
Apr 11 22:19:25 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b819d71-bcc6-4bc2-863c-32d7df9364cd]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[45753de9-a8c8-4813-9651-75a94f145eac]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:19:25 user nova-compute[71364]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)
Apr 11 22:19:25 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:19:25 user nova-compute[71364]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)
Apr 11 22:19:25 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:19:25 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:26 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:26 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4065ea-29f6-450d-8e34-28748337a558]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:26 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:19:27 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:19:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRZMhypJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:19:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:19:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23363366533643735', 'path': '/dev/sdc'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:19:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363366533643735', 'path': '/dev/sdc'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:19:27 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'flavor' on Instance uuid c606772c-d1ed-415e-84f4-129319bb3865 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:19:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 22:19:27 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:19:27 user nova-compute[71364]:   <source dev="/dev/sdc"/>
Apr 11 22:19:27 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:19:27 user nova-compute[71364]:   <serial>3124c49b-2f09-41c8-8965-a0e4266f053c</serial>
Apr 11 22:19:27 user nova-compute[71364]: </disk>
Apr 11 22:19:27 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 22:19:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:19:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:19:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] No VIF found with MAC fa:16:3e:8b:11:ea, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:19:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "c606772c-d1ed-415e-84f4-129319bb3865" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.336s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-9f0e0d21-e812-42ad-a198-c3551ad182ba req-d43adc2a-8ec6-4b0d-96a6-380c34194151 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-changed-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:19:31 user nova-compute[71364]: DEBUG nova.compute.manager [req-9f0e0d21-e812-42ad-a198-c3551ad182ba req-d43adc2a-8ec6-4b0d-96a6-380c34194151 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Refreshing instance network info cache due to event network-changed-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:19:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9f0e0d21-e812-42ad-a198-c3551ad182ba req-d43adc2a-8ec6-4b0d-96a6-380c34194151 service nova] Acquiring lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:19:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9f0e0d21-e812-42ad-a198-c3551ad182ba req-d43adc2a-8ec6-4b0d-96a6-380c34194151 service nova] Acquired lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:19:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-9f0e0d21-e812-42ad-a198-c3551ad182ba req-d43adc2a-8ec6-4b0d-96a6-380c34194151 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Refreshing network info cache for port 3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:19:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-9f0e0d21-e812-42ad-a198-c3551ad182ba req-d43adc2a-8ec6-4b0d-96a6-380c34194151 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updated VIF entry in instance network info cache for port 3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:19:31 user nova-compute[71364]: DEBUG nova.network.neutron [req-9f0e0d21-e812-42ad-a198-c3551ad182ba req-d43adc2a-8ec6-4b0d-96a6-380c34194151 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updating instance_info_cache with network_info: [{"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:19:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9f0e0d21-e812-42ad-a198-c3551ad182ba req-d43adc2a-8ec6-4b0d-96a6-380c34194151 service nova] Releasing lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:19:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-04469e09-60bf-4ae2-a079-3ebf311ac43e req-17af44cc-83c6-4047-8c27-f8b3ab1914b3 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-changed-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:19:32 user nova-compute[71364]: DEBUG nova.compute.manager [req-04469e09-60bf-4ae2-a079-3ebf311ac43e req-17af44cc-83c6-4047-8c27-f8b3ab1914b3 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Refreshing instance network info cache due to event network-changed-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:19:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-04469e09-60bf-4ae2-a079-3ebf311ac43e req-17af44cc-83c6-4047-8c27-f8b3ab1914b3 service nova] Acquiring lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:19:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-04469e09-60bf-4ae2-a079-3ebf311ac43e req-17af44cc-83c6-4047-8c27-f8b3ab1914b3 service nova] Acquired lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:19:32 user nova-compute[71364]: DEBUG nova.network.neutron [req-04469e09-60bf-4ae2-a079-3ebf311ac43e req-17af44cc-83c6-4047-8c27-f8b3ab1914b3 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Refreshing network info cache for port 3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:19:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:33 user nova-compute[71364]: DEBUG nova.network.neutron [req-04469e09-60bf-4ae2-a079-3ebf311ac43e req-17af44cc-83c6-4047-8c27-f8b3ab1914b3 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updated VIF entry in instance network info cache for port 3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:19:33 user nova-compute[71364]: DEBUG nova.network.neutron [req-04469e09-60bf-4ae2-a079-3ebf311ac43e req-17af44cc-83c6-4047-8c27-f8b3ab1914b3 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updating instance_info_cache with network_info: [{"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:19:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-04469e09-60bf-4ae2-a079-3ebf311ac43e req-17af44cc-83c6-4047-8c27-f8b3ab1914b3 service nova] Releasing lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:19:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "c606772c-d1ed-415e-84f4-129319bb3865" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:34 user nova-compute[71364]: INFO nova.compute.manager [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Rebooting instance
Apr 11 22:19:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:19:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquired lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:19:34 user nova-compute[71364]: DEBUG nova.network.neutron [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:19:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:35 user nova-compute[71364]: DEBUG nova.network.neutron [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updating instance_info_cache with network_info: [{"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:19:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Releasing lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:19:35 user nova-compute[71364]: DEBUG nova.compute.manager [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:19:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:35 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:35 user nova-compute[71364]: DEBUG nova.compute.manager [req-5af06614-8052-4573-8458-8bb0f39fafa4 req-2b35de62-98d9-4a3e-a1e9-e4c69cd0838f service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-vif-unplugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:19:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5af06614-8052-4573-8458-8bb0f39fafa4 req-2b35de62-98d9-4a3e-a1e9-e4c69cd0838f service nova] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5af06614-8052-4573-8458-8bb0f39fafa4 req-2b35de62-98d9-4a3e-a1e9-e4c69cd0838f service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-5af06614-8052-4573-8458-8bb0f39fafa4 req-2b35de62-98d9-4a3e-a1e9-e4c69cd0838f service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:35 user nova-compute[71364]: DEBUG nova.compute.manager [req-5af06614-8052-4573-8458-8bb0f39fafa4 req-2b35de62-98d9-4a3e-a1e9-e4c69cd0838f service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] No waiting events found dispatching network-vif-unplugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:19:35 user nova-compute[71364]: WARNING nova.compute.manager [req-5af06614-8052-4573-8458-8bb0f39fafa4 req-2b35de62-98d9-4a3e-a1e9-e4c69cd0838f service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received unexpected event network-vif-unplugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 22:19:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:36 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Instance destroyed successfully.
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'resources' on Instance uuid c606772c-d1ed-415e-84f4-129319bb3865 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-607364897',display_name='tempest-TestMinimumBasicScenario-server-607364897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-607364897',id=40,image_ref='13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0E6IW8IC9c9o4usL7v07yI/kkM/pJZNoOtLq6Y9s00xPpXz5e2WgJ8kun4/vc867GqTIrNUz+IIntx6J933ixpIdIU86aX7qU0WxlLh+Lwh+w1WRuI+adzdp2SaCNM3Q==',key_name='tempest-TestMinimumBasicScenario-2097245857',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c29da1948d84b08acbb7893db590608',ramdisk_id='',reservation_id='r-0xdd1no4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1414513068',owner_user_name='tempest-TestMinimumBasicScenario-1414513068-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:19:35Z,user_data=None,user_id='e0e3f97050c448deba7ed9dbe0657c77',uuid=c606772c-d1ed-415e-84f4-129319bb3865,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converting VIF {"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:11:ea,bridge_name='br-int',has_traffic_filtering=True,id=3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae4d6b9-6e') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_vif [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:11:ea,bridge_name='br-int',has_traffic_filtering=True,id=3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae4d6b9-6e') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ae4d6b9-6e, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:19:36 user nova-compute[71364]: INFO os_vif [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:11:ea,bridge_name='br-int',has_traffic_filtering=True,id=3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae4d6b9-6e')
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRZMhypJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:19:36 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8d084a-a6e3-475c-a1f8-e5fd4d41c7b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:19:36 user nova-compute[71364]: No targets found.
Apr 11 22:19:36 user nova-compute[71364]: iSNS:
Apr 11 22:19:36 user nova-compute[71364]: No targets found.
Apr 11 22:19:36 user nova-compute[71364]: STATIC:
Apr 11 22:19:36 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c
Apr 11 22:19:36 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:19:36 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:19:36 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758
Apr 11 22:19:36 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:19:36 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:19:36 user nova-compute[71364]: FIRMWARE:
Apr 11 22:19:36 user nova-compute[71364]: No targets found.
Apr 11 22:19:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:19:36 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:19:36 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4412a6-5c2a-40f2-9b0a-efde9c37de44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa1c067-21c4-48b2-a028-baa6be80c727]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:19:36 user nova-compute[71364]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)
Apr 11 22:19:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:19:36 user nova-compute[71364]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)
Apr 11 22:19:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacc35090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c'): ({'sdc'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Removing single pathed devices sdc {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1771a025-a433-4c0a-a0d8-33004182441b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c33a05-6a18-4316-8b18-37db754dbb5a]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Flushing IO for device /dev/sdc {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[32439e4f-4cfe-4a18-9b30-b1f02e4b454c]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[11291c3e-7e60-4323-9d9a-8ce692c4a4ba]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[675325b7-13f4-4cac-af1e-8b1491176574]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[549a8701-b4ef-4f58-857c-0d97d7abb15b]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260]
Apr 11 22:19:36 user nova-compute[71364]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260] successful.
Apr 11 22:19:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[594422ad-db0c-4596-844d-0bdd68a3b228]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] <== disconnect_volume: return (304ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Start _get_guest_xml network_info=[{"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': '13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRZMhypJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c606772c-d1ed-415e-84f4-129319bb3865', 'attached_at': '', 'detached_at': '', 'volume_id': '3124c49b-2f09-41c8-8965-a0e4266f053c', 'serial': '3124c49b-2f09-41c8-8965-a0e4266f053c'}, 'attachment_id': '2cd0ebd4-38f5-4255-8651-a28446694154', 'mount_device': '/dev/vdb', 'boot_index': None, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:19:36 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:19:36 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'vcpu_model' on Instance uuid c606772c-d1ed-415e-84f4-129319bb3865 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRZMhypJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:19:36 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:19:36 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:19:36 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5833cec7-61a1-4df8-9201-847085cc137d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:19:36 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3446b3ca-a5cb-468c-a24b-9582ca3cf975]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c] added
Apr 11 22:19:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b280a3c-e8df-40ca-8e22-273be735521f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fe4f3a-39a7-4c42-9144-5fca7f24a928]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zRZMhypJ {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zRZMhypJ" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28361a1-abef-465e-8cdb-722a7b4ca75a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zRZMhypJ'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[712ecb4e-2d45-4822-8fa6-e8e681a14f91]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4912bc14-67b5-4593-9214-c71a826ceb94]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:19:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:19:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd6750f-8eaa-4c55-9f82-c313dc25ed2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260]
Apr 11 22:19:36 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260] successful.
Apr 11 22:19:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1296aedf-e7d0-4e7b-b140-b7840f84f934]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8b9366-2db1-4818-aa63-48f7c969742f]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:19:36 user nova-compute[71364]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)
Apr 11 22:19:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:19:36 user nova-compute[71364]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)
Apr 11 22:19:36 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf7969b-d33e-4259-a0dd-0dd825aa03fe]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:19:36 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRZMhypJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:19:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-7201216d-bc66-4c1b-90b5-cd4e03b1ef3c req-a5b2339a-9559-4eaa-8a41-269129243346 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:19:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7201216d-bc66-4c1b-90b5-cd4e03b1ef3c req-a5b2339a-9559-4eaa-8a41-269129243346 service nova] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7201216d-bc66-4c1b-90b5-cd4e03b1ef3c req-a5b2339a-9559-4eaa-8a41-269129243346 service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7201216d-bc66-4c1b-90b5-cd4e03b1ef3c req-a5b2339a-9559-4eaa-8a41-269129243346 service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-7201216d-bc66-4c1b-90b5-cd4e03b1ef3c req-a5b2339a-9559-4eaa-8a41-269129243346 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] No waiting events found dispatching network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:19:37 user nova-compute[71364]: WARNING nova.compute.manager [req-7201216d-bc66-4c1b-90b5-cd4e03b1ef3c req-a5b2339a-9559-4eaa-8a41-269129243346 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received unexpected event network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 22:19:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:19:37 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23363366533643735', 'path': '/dev/sdc'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:19:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363366533643735', 'path': '/dev/sdc'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:19:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-607364897',display_name='tempest-TestMinimumBasicScenario-server-607364897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-607364897',id=40,image_ref='13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0E6IW8IC9c9o4usL7v07yI/kkM/pJZNoOtLq6Y9s00xPpXz5e2WgJ8kun4/vc867GqTIrNUz+IIntx6J933ixpIdIU86aX7qU0WxlLh+Lwh+w1WRuI+adzdp2SaCNM3Q==',key_name='tempest-TestMinimumBasicScenario-2097245857',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c29da1948d84b08acbb7893db590608',ramdisk_id='',reservation_id='r-0xdd1no4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1414513068',owner_user_name='tempest-TestMinimumBasicScenario-1414513068-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:19:35Z,user_data=None,user_id='e0e3f97050c448deba7ed9dbe0657c77',uuid=c606772c-d1ed-415e-84f4-129319bb3865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:19:37 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converting VIF {"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:19:37 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:11:ea,bridge_name='br-int',has_traffic_filtering=True,id=3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae4d6b9-6e') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:19:37 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'pci_devices' on Instance uuid c606772c-d1ed-415e-84f4-129319bb3865 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:19:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:19:37 user nova-compute[71364]:   <uuid>c606772c-d1ed-415e-84f4-129319bb3865</uuid>
Apr 11 22:19:37 user nova-compute[71364]:   <name>instance-00000028</name>
Apr 11 22:19:37 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:19:37 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:19:37 user nova-compute[71364]:   <metadata>
Apr 11 22:19:37 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:19:37 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:19:37 user nova-compute[71364]:       <nova:name>tempest-TestMinimumBasicScenario-server-607364897</nova:name>
Apr 11 22:19:37 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:19:36</nova:creationTime>
Apr 11 22:19:37 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:19:37 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:19:37 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:19:37 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:19:37 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:19:37 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:19:37 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:19:37 user nova-compute[71364]:       <nova:owner>
Apr 11 22:19:37 user nova-compute[71364]:         <nova:user uuid="e0e3f97050c448deba7ed9dbe0657c77">tempest-TestMinimumBasicScenario-1414513068-project-member</nova:user>
Apr 11 22:19:37 user nova-compute[71364]:         <nova:project uuid="8c29da1948d84b08acbb7893db590608">tempest-TestMinimumBasicScenario-1414513068</nova:project>
Apr 11 22:19:37 user nova-compute[71364]:       </nova:owner>
Apr 11 22:19:37 user nova-compute[71364]:       <nova:root type="image" uuid="13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4"/>
Apr 11 22:19:37 user nova-compute[71364]:       <nova:ports>
Apr 11 22:19:37 user nova-compute[71364]:         <nova:port uuid="3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3">
Apr 11 22:19:37 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 11 22:19:37 user nova-compute[71364]:         </nova:port>
Apr 11 22:19:37 user nova-compute[71364]:       </nova:ports>
Apr 11 22:19:37 user nova-compute[71364]:     </nova:instance>
Apr 11 22:19:37 user nova-compute[71364]:   </metadata>
Apr 11 22:19:37 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:19:37 user nova-compute[71364]:     <system>
Apr 11 22:19:37 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:19:37 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:19:37 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:19:37 user nova-compute[71364]:       <entry name="serial">c606772c-d1ed-415e-84f4-129319bb3865</entry>
Apr 11 22:19:37 user nova-compute[71364]:       <entry name="uuid">c606772c-d1ed-415e-84f4-129319bb3865</entry>
Apr 11 22:19:37 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:19:37 user nova-compute[71364]:     </system>
Apr 11 22:19:37 user nova-compute[71364]:   </sysinfo>
Apr 11 22:19:37 user nova-compute[71364]:   <os>
Apr 11 22:19:37 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:19:37 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:19:37 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:19:37 user nova-compute[71364]:   </os>
Apr 11 22:19:37 user nova-compute[71364]:   <features>
Apr 11 22:19:37 user nova-compute[71364]:     <acpi/>
Apr 11 22:19:37 user nova-compute[71364]:     <apic/>
Apr 11 22:19:37 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:19:37 user nova-compute[71364]:   </features>
Apr 11 22:19:37 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:19:37 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:19:37 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:19:37 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:19:37 user nova-compute[71364]:   </clock>
Apr 11 22:19:37 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:19:37 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:19:37 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:19:37 user nova-compute[71364]:   </cpu>
Apr 11 22:19:37 user nova-compute[71364]:   <devices>
Apr 11 22:19:37 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:19:37 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:19:37 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk"/>
Apr 11 22:19:37 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:19:37 user nova-compute[71364]:     </disk>
Apr 11 22:19:37 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 22:19:37 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:19:37 user nova-compute[71364]:       <source dev="/dev/sdc"/>
Apr 11 22:19:37 user nova-compute[71364]:       <target dev="vdb" bus="virtio"/>
Apr 11 22:19:37 user nova-compute[71364]:       <serial>3124c49b-2f09-41c8-8965-a0e4266f053c</serial>
Apr 11 22:19:37 user nova-compute[71364]:     </disk>
Apr 11 22:19:37 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:19:37 user nova-compute[71364]:       <mac address="fa:16:3e:8b:11:ea"/>
Apr 11 22:19:37 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:19:37 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:19:37 user nova-compute[71364]:       <target dev="tap3ae4d6b9-6e"/>
Apr 11 22:19:37 user nova-compute[71364]:     </interface>
Apr 11 22:19:37 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:19:37 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/console.log" append="off"/>
Apr 11 22:19:37 user nova-compute[71364]:     </serial>
Apr 11 22:19:37 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:19:37 user nova-compute[71364]:     <video>
Apr 11 22:19:37 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:19:37 user nova-compute[71364]:     </video>
Apr 11 22:19:37 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:19:37 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:19:37 user nova-compute[71364]:     </rng>
Apr 11 22:19:37 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:19:37 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:19:37 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:19:37 user nova-compute[71364]:     </memballoon>
Apr 11 22:19:37 user nova-compute[71364]:   </devices>
Apr 11 22:19:37 user nova-compute[71364]: </domain>
Apr 11 22:19:37 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:19:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "5561da61-cae9-4365-83bc-923ab7b3a439" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "5561da61-cae9-4365-83bc-923ab7b3a439" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'trusted_certs' on Instance uuid c606772c-d1ed-415e-84f4-129319bb3865 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:19:38 user nova-compute[71364]: INFO nova.compute.claims [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Claim successful on node user
Apr 11 22:19:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59 --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Cannot resize image /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.objects.instance [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'migration_context' on Instance uuid c606772c-d1ed-415e-84f4-129319bb3865 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-607364897',display_name='tempest-TestMinimumBasicScenario-server-607364897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-607364897',id=40,image_ref='13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0E6IW8IC9c9o4usL7v07yI/kkM/pJZNoOtLq6Y9s00xPpXz5e2WgJ8kun4/vc867GqTIrNUz+IIntx6J933ixpIdIU86aX7qU0WxlLh+Lwh+w1WRuI+adzdp2SaCNM3Q==',key_name='tempest-TestMinimumBasicScenario-2097245857',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='8c29da1948d84b08acbb7893db590608',ramdisk_id='',reservation_id='r-0xdd1no4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1414513068',owner_user_name='tempest-TestMinimumBasicScenario-1414513068-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:19:35Z,user_data=None,user_id='e0e3f97050c448deba7ed9dbe0657c77',uuid=c606772c-d1ed-415e-84f4-129319bb3865,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converting VIF {"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:11:ea,bridge_name='br-int',has_traffic_filtering=True,id=3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae4d6b9-6e') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG os_vif [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:11:ea,bridge_name='br-int',has_traffic_filtering=True,id=3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae4d6b9-6e') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ae4d6b9-6e, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ae4d6b9-6e, col_values=(('external_ids', {'iface-id': '3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:11:ea', 'vm-uuid': 'c606772c-d1ed-415e-84f4-129319bb3865'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:38 user nova-compute[71364]: INFO os_vif [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:11:ea,bridge_name='br-int',has_traffic_filtering=True,id=3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae4d6b9-6e')
Apr 11 22:19:38 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:19:38 user nova-compute[71364]: INFO nova.virt.block_device [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Booting with volume snapshot 23385529-5806-4db1-95d1-cc97aa4defa6 at /dev/vda
Apr 11 22:19:38 user nova-compute[71364]: DEBUG nova.policy [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:19:39 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Successfully created port: a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:19:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:40 user nova-compute[71364]: DEBUG nova.compute.manager [req-7a901952-ab04-41fa-a5a4-9be83e1b065c req-a3474439-edc9-449e-8095-e9ce51802d8d service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:19:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7a901952-ab04-41fa-a5a4-9be83e1b065c req-a3474439-edc9-449e-8095-e9ce51802d8d service nova] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7a901952-ab04-41fa-a5a4-9be83e1b065c req-a3474439-edc9-449e-8095-e9ce51802d8d service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-7a901952-ab04-41fa-a5a4-9be83e1b065c req-a3474439-edc9-449e-8095-e9ce51802d8d service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:40 user nova-compute[71364]: DEBUG nova.compute.manager [req-7a901952-ab04-41fa-a5a4-9be83e1b065c req-a3474439-edc9-449e-8095-e9ce51802d8d service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] No waiting events found dispatching network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:19:40 user nova-compute[71364]: WARNING nova.compute.manager [req-7a901952-ab04-41fa-a5a4-9be83e1b065c req-a3474439-edc9-449e-8095-e9ce51802d8d service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received unexpected event network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance with vm_state active and task_state reboot_started_hard.
Apr 11 22:19:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:40 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:40 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Successfully updated port: a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:19:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "refresh_cache-5561da61-cae9-4365-83bc-923ab7b3a439" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:19:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquired lock "refresh_cache-5561da61-cae9-4365-83bc-923ab7b3a439" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:19:40 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:19:40 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:19:41 user nova-compute[71364]: DEBUG nova.network.neutron [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Updating instance_info_cache with network_info: [{"id": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "address": "fa:16:3e:bb:97:6e", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8dcbc9c-53", "ovs_interfaceid": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:19:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Releasing lock "refresh_cache-5561da61-cae9-4365-83bc-923ab7b3a439" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:19:41 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Instance network_info: |[{"id": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "address": "fa:16:3e:bb:97:6e", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8dcbc9c-53", "ovs_interfaceid": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for c606772c-d1ed-415e-84f4-129319bb3865 due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251582.037179, c606772c-d1ed-415e-84f4-129319bb3865 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:19:42 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] VM Resumed (Lifecycle Event)
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:19:42 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Instance rebooted successfully.
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:19:42 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251582.0386791, c606772c-d1ed-415e-84f4-129319bb3865 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:19:42 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] VM Started (Lifecycle Event)
Apr 11 22:19:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "c606772c-d1ed-415e-84f4-129319bb3865" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.614s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] No waiting events found dispatching network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:19:42 user nova-compute[71364]: WARNING nova.compute.manager [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received unexpected event network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance with vm_state active and task_state None.
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Received event network-changed-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Refreshing instance network info cache due to event network-changed-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] Acquiring lock "refresh_cache-5561da61-cae9-4365-83bc-923ab7b3a439" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] Acquired lock "refresh_cache-5561da61-cae9-4365-83bc-923ab7b3a439" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.network.neutron [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Refreshing network info cache for port a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.network.neutron [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Updated VIF entry in instance network info cache for port a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG nova.network.neutron [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Updating instance_info_cache with network_info: [{"id": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "address": "fa:16:3e:bb:97:6e", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8dcbc9c-53", "ovs_interfaceid": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:19:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] Releasing lock "refresh_cache-5561da61-cae9-4365-83bc-923ab7b3a439" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:19:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG os_brick.utils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab238672-fa83-4093-881e-85045488308a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c780c71c-635f-4c24-aca6-3688964f3120]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[329b77b9-c63a-4152-820e-411721a92076]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c64de78-e89b-48e0-a1f6-bb7a48511490]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:19:44 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:19:44 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eea6764-63a4-4853-934b-d60aa3592ce7]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG os_brick.utils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Updating existing volume attachment record: c5dfe077-cb0b-4bd6-bd58-d95a753a9361 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:19:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:46 user nova-compute[71364]: DEBUG nova.compute.manager [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:19:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:46 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:19:46 user nova-compute[71364]: INFO nova.compute.claims [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Claim successful on node user
Apr 11 22:19:46 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:19:46 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:19:46 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:46 user nova-compute[71364]: DEBUG nova.compute.manager [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG nova.compute.manager [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG nova.network.neutron [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:19:47 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:19:47 user nova-compute[71364]: DEBUG nova.compute.manager [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG nova.policy [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG nova.compute.manager [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:19:47 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Creating image(s)
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "/opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "/opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "/opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "d333d8b0d306aabd40f87b470a0113e9a8049793" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.151s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793,backing_fmt=raw /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk 1073741824" returned: 0 in 0.047s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "d333d8b0d306aabd40f87b470a0113e9a8049793" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Cannot resize image /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG nova.objects.instance [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'migration_context' on Instance uuid 3879bb47-6592-4d9d-9e3c-fbbfc688335e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Ensure instance console log exists: /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:47 user nova-compute[71364]: DEBUG nova.network.neutron [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Successfully created port: b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:19:48 user nova-compute[71364]: DEBUG nova.network.neutron [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Successfully updated port: b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:19:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:19:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquired lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:19:48 user nova-compute[71364]: DEBUG nova.network.neutron [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:19:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-2b231d7e-6dd0-4b40-8703-a6f1fdfd2eb3 req-2c7b9570-9921-4b2f-adcf-aeebeb635f44 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received event network-changed-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:19:48 user nova-compute[71364]: DEBUG nova.compute.manager [req-2b231d7e-6dd0-4b40-8703-a6f1fdfd2eb3 req-2c7b9570-9921-4b2f-adcf-aeebeb635f44 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Refreshing instance network info cache due to event network-changed-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:19:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2b231d7e-6dd0-4b40-8703-a6f1fdfd2eb3 req-2c7b9570-9921-4b2f-adcf-aeebeb635f44 service nova] Acquiring lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:19:48 user nova-compute[71364]: DEBUG nova.network.neutron [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.network.neutron [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updating instance_info_cache with network_info: [{"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Releasing lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.compute.manager [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Instance network_info: |[{"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2b231d7e-6dd0-4b40-8703-a6f1fdfd2eb3 req-2c7b9570-9921-4b2f-adcf-aeebeb635f44 service nova] Acquired lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.network.neutron [req-2b231d7e-6dd0-4b40-8703-a6f1fdfd2eb3 req-2c7b9570-9921-4b2f-adcf-aeebeb635f44 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Refreshing network info cache for port b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Start _get_guest_xml network_info=[{"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:19:49 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:19:49 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T21:46:10Z,direct_url=<?>,disk_format='qcow2',id=ca576860-9db2-47a8-a5c5-dc172050b182,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='f2f1c68f95cc4183b127590afce31d0d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T21:46:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1104269846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1104269846',id=43,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9ha7w4Yx2Ct4yNyWAG+y2X1fGRwyualBpBeukX0mkbXyGthnVwMyhQhZxUhJmIzxFqpZJ/5uqBRNCMtZuCVp7UVwu5uwMc/x/kd2EHdYmC74j0KpKixiMzFdJ8OyMPZg==',key_name='tempest-keypair-75772273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29e79d7c2e144af59f911973e79ba110',ramdisk_id='',reservation_id='r-49yyiiel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-590407943',owner_user_name='tempest-AttachVolumeShelveTestJSON-590407943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:19:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5898621881a4e799df121e1d5957f42',uuid=3879bb47-6592-4d9d-9e3c-fbbfc688335e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converting VIF {"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4da2fe7-4f') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.objects.instance [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'pci_devices' on Instance uuid 3879bb47-6592-4d9d-9e3c-fbbfc688335e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:19:49 user nova-compute[71364]:   <uuid>3879bb47-6592-4d9d-9e3c-fbbfc688335e</uuid>
Apr 11 22:19:49 user nova-compute[71364]:   <name>instance-0000002b</name>
Apr 11 22:19:49 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:19:49 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:19:49 user nova-compute[71364]:   <metadata>
Apr 11 22:19:49 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:19:49 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:19:49 user nova-compute[71364]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1104269846</nova:name>
Apr 11 22:19:49 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:19:49</nova:creationTime>
Apr 11 22:19:49 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:19:49 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:19:49 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:19:49 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:19:49 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:19:49 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:19:49 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:19:49 user nova-compute[71364]:       <nova:owner>
Apr 11 22:19:49 user nova-compute[71364]:         <nova:user uuid="e5898621881a4e799df121e1d5957f42">tempest-AttachVolumeShelveTestJSON-590407943-project-member</nova:user>
Apr 11 22:19:49 user nova-compute[71364]:         <nova:project uuid="29e79d7c2e144af59f911973e79ba110">tempest-AttachVolumeShelveTestJSON-590407943</nova:project>
Apr 11 22:19:49 user nova-compute[71364]:       </nova:owner>
Apr 11 22:19:49 user nova-compute[71364]:       <nova:root type="image" uuid="ca576860-9db2-47a8-a5c5-dc172050b182"/>
Apr 11 22:19:49 user nova-compute[71364]:       <nova:ports>
Apr 11 22:19:49 user nova-compute[71364]:         <nova:port uuid="b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a">
Apr 11 22:19:49 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 22:19:49 user nova-compute[71364]:         </nova:port>
Apr 11 22:19:49 user nova-compute[71364]:       </nova:ports>
Apr 11 22:19:49 user nova-compute[71364]:     </nova:instance>
Apr 11 22:19:49 user nova-compute[71364]:   </metadata>
Apr 11 22:19:49 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:19:49 user nova-compute[71364]:     <system>
Apr 11 22:19:49 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:19:49 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:19:49 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:19:49 user nova-compute[71364]:       <entry name="serial">3879bb47-6592-4d9d-9e3c-fbbfc688335e</entry>
Apr 11 22:19:49 user nova-compute[71364]:       <entry name="uuid">3879bb47-6592-4d9d-9e3c-fbbfc688335e</entry>
Apr 11 22:19:49 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:19:49 user nova-compute[71364]:     </system>
Apr 11 22:19:49 user nova-compute[71364]:   </sysinfo>
Apr 11 22:19:49 user nova-compute[71364]:   <os>
Apr 11 22:19:49 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:19:49 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:19:49 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:19:49 user nova-compute[71364]:   </os>
Apr 11 22:19:49 user nova-compute[71364]:   <features>
Apr 11 22:19:49 user nova-compute[71364]:     <acpi/>
Apr 11 22:19:49 user nova-compute[71364]:     <apic/>
Apr 11 22:19:49 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:19:49 user nova-compute[71364]:   </features>
Apr 11 22:19:49 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:19:49 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:19:49 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:19:49 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:19:49 user nova-compute[71364]:   </clock>
Apr 11 22:19:49 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:19:49 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:19:49 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:19:49 user nova-compute[71364]:   </cpu>
Apr 11 22:19:49 user nova-compute[71364]:   <devices>
Apr 11 22:19:49 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:19:49 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:19:49 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk"/>
Apr 11 22:19:49 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:19:49 user nova-compute[71364]:     </disk>
Apr 11 22:19:49 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:19:49 user nova-compute[71364]:       <mac address="fa:16:3e:a6:d0:58"/>
Apr 11 22:19:49 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:19:49 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:19:49 user nova-compute[71364]:       <target dev="tapb4da2fe7-4f"/>
Apr 11 22:19:49 user nova-compute[71364]:     </interface>
Apr 11 22:19:49 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:19:49 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/console.log" append="off"/>
Apr 11 22:19:49 user nova-compute[71364]:     </serial>
Apr 11 22:19:49 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:19:49 user nova-compute[71364]:     <video>
Apr 11 22:19:49 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:19:49 user nova-compute[71364]:     </video>
Apr 11 22:19:49 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:19:49 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:19:49 user nova-compute[71364]:     </rng>
Apr 11 22:19:49 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:19:49 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:19:49 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:19:49 user nova-compute[71364]:     </memballoon>
Apr 11 22:19:49 user nova-compute[71364]:   </devices>
Apr 11 22:19:49 user nova-compute[71364]: </domain>
Apr 11 22:19:49 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1104269846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1104269846',id=43,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9ha7w4Yx2Ct4yNyWAG+y2X1fGRwyualBpBeukX0mkbXyGthnVwMyhQhZxUhJmIzxFqpZJ/5uqBRNCMtZuCVp7UVwu5uwMc/x/kd2EHdYmC74j0KpKixiMzFdJ8OyMPZg==',key_name='tempest-keypair-75772273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29e79d7c2e144af59f911973e79ba110',ramdisk_id='',reservation_id='r-49yyiiel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-590407943',owner_user_name='tempest-AttachVolumeShelveTestJSON-590407943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:19:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5898621881a4e799df121e1d5957f42',uuid=3879bb47-6592-4d9d-9e3c-fbbfc688335e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converting VIF {"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4da2fe7-4f') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG os_vif [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4da2fe7-4f') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4da2fe7-4f, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4da2fe7-4f, col_values=(('external_ids', {'iface-id': 'b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:d0:58', 'vm-uuid': '3879bb47-6592-4d9d-9e3c-fbbfc688335e'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:49 user nova-compute[71364]: INFO os_vif [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4da2fe7-4f')
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] No VIF found with MAC fa:16:3e:a6:d0:58, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:19:49 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Creating image(s)
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Ensure instance console log exists: /opt/stack/data/nova/instances/5561da61-cae9-4365-83bc-923ab7b3a439/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Start _get_guest_xml network_info=[{"id": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "address": "fa:16:3e:bb:97:6e", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8dcbc9c-53", "ovs_interfaceid": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-11T22:19:35Z,direct_url=<?>,disk_format='qcow2',id=4e9d3308-18ec-4f90-a852-f730bdb45f15,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2097773246',owner='eb843e213c594ac28f864550ad68833b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-11T22:19:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JwKBSjIM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5561da61-cae9-4365-83bc-923ab7b3a439', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8fe4b31-b103-468b-b494-eebee0ccad96', 'serial': 'd8fe4b31-b103-468b-b494-eebee0ccad96'}, 'attachment_id': 'c5dfe077-cb0b-4bd6-bd58-d95a753a9361', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:19:49 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:19:49 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-11T22:19:35Z,direct_url=<?>,disk_format='qcow2',id=4e9d3308-18ec-4f90-a852-f730bdb45f15,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2097773246',owner='eb843e213c594ac28f864550ad68833b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-11T22:19:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JwKBSjIM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:19:49 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:19:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:19:49 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:19:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:19:49 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.network.neutron [req-2b231d7e-6dd0-4b40-8703-a6f1fdfd2eb3 req-2c7b9570-9921-4b2f-adcf-aeebeb635f44 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updated VIF entry in instance network info cache for port b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG nova.network.neutron [req-2b231d7e-6dd0-4b40-8703-a6f1fdfd2eb3 req-2c7b9570-9921-4b2f-adcf-aeebeb635f44 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updating instance_info_cache with network_info: [{"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2b231d7e-6dd0-4b40-8703-a6f1fdfd2eb3 req-2c7b9570-9921-4b2f-adcf-aeebeb635f44 service nova] Releasing lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefca455-6148-46ea-ad0d-e32ff84a2a40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:19:49 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[406418f4-20e1-4003-aff6-a4e995d963d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96] added
Apr 11 22:19:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[69adcc63-9a0c-45a4-a039-58a3509af8cc]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ecd7e7-a579-4361-9509-d9e07576b7af]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JwKBSjIM {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JwKBSjIM" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7e5cee-d869-484c-8003-b65446f4b5b1]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JwKBSjIM'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7117f2ed-03d1-4e3e-8a73-a4e5bc7788f2]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b5d874-42df-4b1b-9d6f-4695d1525816]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:19:50 user nova-compute[71364]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)
Apr 11 22:19:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:19:50 user nova-compute[71364]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)
Apr 11 22:19:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0316e1b-d96e-4fb6-a2bd-d27a53856887]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96, portal: 172.16.0.220,3260]
Apr 11 22:19:50 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96, portal: 172.16.0.220,3260] successful.
Apr 11 22:19:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad31d69-5198-4728-9275-50210f47af51]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0079cb7-ff4a-4aae-a569-48cc2acb87d5]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:19:50 user nova-compute[71364]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)
Apr 11 22:19:50 user nova-compute[71364]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 (non-flash)
Apr 11 22:19:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:19:50 user nova-compute[71364]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)
Apr 11 22:19:50 user nova-compute[71364]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 (non-flash)
Apr 11 22:19:50 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bb3363-f31f-44ee-9e2b-868543f47e5c]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JwKBSjIM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-c8897a7e-7f17-4c17-85c5-7f673dad7015 req-87f4faee-45ea-4524-a8cf-6ad59db16671 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received event network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c8897a7e-7f17-4c17-85c5-7f673dad7015 req-87f4faee-45ea-4524-a8cf-6ad59db16671 service nova] Acquiring lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c8897a7e-7f17-4c17-85c5-7f673dad7015 req-87f4faee-45ea-4524-a8cf-6ad59db16671 service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c8897a7e-7f17-4c17-85c5-7f673dad7015 req-87f4faee-45ea-4524-a8cf-6ad59db16671 service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-c8897a7e-7f17-4c17-85c5-7f673dad7015 req-87f4faee-45ea-4524-a8cf-6ad59db16671 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] No waiting events found dispatching network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:19:51 user nova-compute[71364]: WARNING nova.compute.manager [req-c8897a7e-7f17-4c17-85c5-7f673dad7015 req-87f4faee-45ea-4524-a8cf-6ad59db16671 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received unexpected event network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance with vm_state building and task_state spawning.
Apr 11 22:19:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23436643261373765', 'path': '/dev/sdd'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436643261373765', 'path': '/dev/sdd'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:19:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-521483110',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-521483110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-521483110',id=42,image_ref='4e9d3308-18ec-4f90-a852-f730bdb45f15',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-x00ga654',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1208917682',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:19:39Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=5561da61-cae9-4365-83bc-923ab7b3a439,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "address": "fa:16:3e:bb:97:6e", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8dcbc9c-53", "ovs_interfaceid": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "address": "fa:16:3e:bb:97:6e", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8dcbc9c-53", "ovs_interfaceid": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:97:6e,bridge_name='br-int',has_traffic_filtering=True,id=a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8dcbc9c-53') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG nova.objects.instance [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lazy-loading 'pci_devices' on Instance uuid 5561da61-cae9-4365-83bc-923ab7b3a439 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:19:51 user nova-compute[71364]:   <uuid>5561da61-cae9-4365-83bc-923ab7b3a439</uuid>
Apr 11 22:19:51 user nova-compute[71364]:   <name>instance-0000002a</name>
Apr 11 22:19:51 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:19:51 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:19:51 user nova-compute[71364]:   <metadata>
Apr 11 22:19:51 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:19:51 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:19:51 user nova-compute[71364]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-521483110</nova:name>
Apr 11 22:19:51 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:19:49</nova:creationTime>
Apr 11 22:19:51 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:19:51 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:19:51 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:19:51 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:19:51 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:19:51 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:19:51 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:19:51 user nova-compute[71364]:       <nova:owner>
Apr 11 22:19:51 user nova-compute[71364]:         <nova:user uuid="4fdb893b6ea3402788a89740355fa935">tempest-TestVolumeBootPattern-1208917682-project-member</nova:user>
Apr 11 22:19:51 user nova-compute[71364]:         <nova:project uuid="eb843e213c594ac28f864550ad68833b">tempest-TestVolumeBootPattern-1208917682</nova:project>
Apr 11 22:19:51 user nova-compute[71364]:       </nova:owner>
Apr 11 22:19:51 user nova-compute[71364]:       <nova:root type="image" uuid="4e9d3308-18ec-4f90-a852-f730bdb45f15"/>
Apr 11 22:19:51 user nova-compute[71364]:       <nova:ports>
Apr 11 22:19:51 user nova-compute[71364]:         <nova:port uuid="a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09">
Apr 11 22:19:51 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 11 22:19:51 user nova-compute[71364]:         </nova:port>
Apr 11 22:19:51 user nova-compute[71364]:       </nova:ports>
Apr 11 22:19:51 user nova-compute[71364]:     </nova:instance>
Apr 11 22:19:51 user nova-compute[71364]:   </metadata>
Apr 11 22:19:51 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:19:51 user nova-compute[71364]:     <system>
Apr 11 22:19:51 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:19:51 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:19:51 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:19:51 user nova-compute[71364]:       <entry name="serial">5561da61-cae9-4365-83bc-923ab7b3a439</entry>
Apr 11 22:19:51 user nova-compute[71364]:       <entry name="uuid">5561da61-cae9-4365-83bc-923ab7b3a439</entry>
Apr 11 22:19:51 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:19:51 user nova-compute[71364]:     </system>
Apr 11 22:19:51 user nova-compute[71364]:   </sysinfo>
Apr 11 22:19:51 user nova-compute[71364]:   <os>
Apr 11 22:19:51 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:19:51 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:19:51 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:19:51 user nova-compute[71364]:   </os>
Apr 11 22:19:51 user nova-compute[71364]:   <features>
Apr 11 22:19:51 user nova-compute[71364]:     <acpi/>
Apr 11 22:19:51 user nova-compute[71364]:     <apic/>
Apr 11 22:19:51 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:19:51 user nova-compute[71364]:   </features>
Apr 11 22:19:51 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:19:51 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:19:51 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:19:51 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:19:51 user nova-compute[71364]:   </clock>
Apr 11 22:19:51 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:19:51 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:19:51 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:19:51 user nova-compute[71364]:   </cpu>
Apr 11 22:19:51 user nova-compute[71364]:   <devices>
Apr 11 22:19:51 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 22:19:51 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:19:51 user nova-compute[71364]:       <source dev="/dev/sdd"/>
Apr 11 22:19:51 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:19:51 user nova-compute[71364]:       <serial>d8fe4b31-b103-468b-b494-eebee0ccad96</serial>
Apr 11 22:19:51 user nova-compute[71364]:     </disk>
Apr 11 22:19:51 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:19:51 user nova-compute[71364]:       <mac address="fa:16:3e:bb:97:6e"/>
Apr 11 22:19:51 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:19:51 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:19:51 user nova-compute[71364]:       <target dev="tapa8dcbc9c-53"/>
Apr 11 22:19:51 user nova-compute[71364]:     </interface>
Apr 11 22:19:51 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:19:51 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/5561da61-cae9-4365-83bc-923ab7b3a439/console.log" append="off"/>
Apr 11 22:19:51 user nova-compute[71364]:     </serial>
Apr 11 22:19:51 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:19:51 user nova-compute[71364]:     <video>
Apr 11 22:19:51 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:19:51 user nova-compute[71364]:     </video>
Apr 11 22:19:51 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:19:51 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:19:51 user nova-compute[71364]:     </rng>
Apr 11 22:19:51 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:19:51 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:19:51 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:19:51 user nova-compute[71364]:     </memballoon>
Apr 11 22:19:51 user nova-compute[71364]:   </devices>
Apr 11 22:19:51 user nova-compute[71364]: </domain>
Apr 11 22:19:51 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:19:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-521483110',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-521483110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-521483110',id=42,image_ref='4e9d3308-18ec-4f90-a852-f730bdb45f15',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-x00ga654',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1208917682',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:19:39Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=5561da61-cae9-4365-83bc-923ab7b3a439,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "address": "fa:16:3e:bb:97:6e", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8dcbc9c-53", "ovs_interfaceid": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "address": "fa:16:3e:bb:97:6e", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8dcbc9c-53", "ovs_interfaceid": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:97:6e,bridge_name='br-int',has_traffic_filtering=True,id=a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8dcbc9c-53') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG os_vif [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:97:6e,bridge_name='br-int',has_traffic_filtering=True,id=a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8dcbc9c-53') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8dcbc9c-53, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa8dcbc9c-53, col_values=(('external_ids', {'iface-id': 'a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:97:6e', 'vm-uuid': '5561da61-cae9-4365-83bc-923ab7b3a439'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:51 user nova-compute[71364]: INFO os_vif [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:97:6e,bridge_name='br-int',has_traffic_filtering=True,id=a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8dcbc9c-53')
Apr 11 22:19:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] No VIF found with MAC fa:16:3e:bb:97:6e, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received event network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Acquiring lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] No waiting events found dispatching network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:19:53 user nova-compute[71364]: WARNING nova.compute.manager [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received unexpected event network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance with vm_state building and task_state spawning.
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Received event network-vif-plugged-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Acquiring lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] No waiting events found dispatching network-vif-plugged-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:19:53 user nova-compute[71364]: WARNING nova.compute.manager [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Received unexpected event network-vif-plugged-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 for instance with vm_state building and task_state spawning.
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Received event network-vif-plugged-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Acquiring lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.compute.manager [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] No waiting events found dispatching network-vif-plugged-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:19:53 user nova-compute[71364]: WARNING nova.compute.manager [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Received unexpected event network-vif-plugged-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 for instance with vm_state building and task_state spawning.
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251593.2740288, 3879bb47-6592-4d9d-9e3c-fbbfc688335e => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:19:53 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] VM Resumed (Lifecycle Event)
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:19:53 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Instance spawned successfully.
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:19:53 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251593.2743247, 3879bb47-6592-4d9d-9e3c-fbbfc688335e => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:19:53 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] VM Started (Lifecycle Event)
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:19:53 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:19:53 user nova-compute[71364]: INFO nova.compute.manager [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Took 6.20 seconds to spawn the instance on the hypervisor.
Apr 11 22:19:53 user nova-compute[71364]: DEBUG nova.compute.manager [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:19:53 user nova-compute[71364]: INFO nova.compute.manager [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Took 6.77 seconds to build instance.
Apr 11 22:19:53 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.877s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:54 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251594.9002786, 5561da61-cae9-4365-83bc-923ab7b3a439 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:19:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] VM Resumed (Lifecycle Event)
Apr 11 22:19:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:19:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:19:54 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Instance spawned successfully.
Apr 11 22:19:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:19:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:19:54 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:19:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:19:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:19:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:19:54 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251594.9043474, 5561da61-cae9-4365-83bc-923ab7b3a439 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:19:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] VM Started (Lifecycle Event)
Apr 11 22:19:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:19:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:19:54 user nova-compute[71364]: INFO nova.compute.manager [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Took 5.08 seconds to spawn the instance on the hypervisor.
Apr 11 22:19:54 user nova-compute[71364]: DEBUG nova.compute.manager [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:19:54 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:19:55 user nova-compute[71364]: INFO nova.compute.manager [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Took 16.83 seconds to build instance.
Apr 11 22:19:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "5561da61-cae9-4365-83bc-923ab7b3a439" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.935s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:19:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:19:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:20:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:20:11 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:20:11 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:20:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8406MB free_disk=26.121196746826172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:20:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:20:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:20:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c606772c-d1ed-415e-84f4-129319bb3865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:20:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 6c682755-7a09-4872-8be2-c429ced2debe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:20:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5561da61-cae9-4365-83bc-923ab7b3a439 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:20:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:20:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:20:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:20:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:11 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:20:11 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:20:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:20:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:20:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:20:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:17 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:20:17 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:20:18 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:20:19 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:20:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:20:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-6c682755-7a09-4872-8be2-c429ced2debe" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:20:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-6c682755-7a09-4872-8be2-c429ced2debe" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:20:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:20:19 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Updating instance_info_cache with network_info: [{"id": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "address": "fa:16:3e:22:7a:fd", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d928c8-12", "ovs_interfaceid": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:20:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-6c682755-7a09-4872-8be2-c429ced2debe" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:20:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:20:19 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:20:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:20:20 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:20:21 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:20:21 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:20:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:20:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:20:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:20:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:20:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:20:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:20:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:20:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:21:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:21:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:21:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:21:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:21:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:21:11 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:21:11 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=26.120391845703125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c606772c-d1ed-415e-84f4-129319bb3865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 6c682755-7a09-4872-8be2-c429ced2debe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 5561da61-cae9-4365-83bc-923ab7b3a439 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing inventories for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating ProviderTree inventory for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating inventory in ProviderTree for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing aggregate associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, aggregates: None {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing trait associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:21:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:21:13 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:21:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:19 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:21:19 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:21:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:20 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:21:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:21:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 22:21:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:21:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:21:20 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:21:20 user nova-compute[71364]: DEBUG nova.objects.instance [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lazy-loading 'info_cache' on Instance uuid c606772c-d1ed-415e-84f4-129319bb3865 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:21:20 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updating instance_info_cache with network_info: [{"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:21:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:21:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:21:20 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:21:20 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:21:20 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:21:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71364) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 22:21:21 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:21:21 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:21:21 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:21:21 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 22:21:21 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] There are 0 instances to clean {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 22:21:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:23 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:21:23 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:21:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:26 user nova-compute[71364]: DEBUG nova.compute.manager [req-32212bdd-51c2-4667-8522-4de1175db862 req-a34f2505-9dfc-4a42-a9c6-52d51fc258a5 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-changed-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:21:26 user nova-compute[71364]: DEBUG nova.compute.manager [req-32212bdd-51c2-4667-8522-4de1175db862 req-a34f2505-9dfc-4a42-a9c6-52d51fc258a5 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Refreshing instance network info cache due to event network-changed-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:21:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-32212bdd-51c2-4667-8522-4de1175db862 req-a34f2505-9dfc-4a42-a9c6-52d51fc258a5 service nova] Acquiring lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:21:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-32212bdd-51c2-4667-8522-4de1175db862 req-a34f2505-9dfc-4a42-a9c6-52d51fc258a5 service nova] Acquired lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:21:26 user nova-compute[71364]: DEBUG nova.network.neutron [req-32212bdd-51c2-4667-8522-4de1175db862 req-a34f2505-9dfc-4a42-a9c6-52d51fc258a5 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Refreshing network info cache for port 3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:21:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:26 user nova-compute[71364]: DEBUG nova.network.neutron [req-32212bdd-51c2-4667-8522-4de1175db862 req-a34f2505-9dfc-4a42-a9c6-52d51fc258a5 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updated VIF entry in instance network info cache for port 3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:21:26 user nova-compute[71364]: DEBUG nova.network.neutron [req-32212bdd-51c2-4667-8522-4de1175db862 req-a34f2505-9dfc-4a42-a9c6-52d51fc258a5 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updating instance_info_cache with network_info: [{"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:21:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-32212bdd-51c2-4667-8522-4de1175db862 req-a34f2505-9dfc-4a42-a9c6-52d51fc258a5 service nova] Releasing lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-1215f623-40c6-47c9-ba9c-a0fe8eefd262 req-67c8d242-75c8-4c13-b55d-e6922a3ed9fe service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-changed-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG nova.compute.manager [req-1215f623-40c6-47c9-ba9c-a0fe8eefd262 req-67c8d242-75c8-4c13-b55d-e6922a3ed9fe service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Refreshing instance network info cache due to event network-changed-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1215f623-40c6-47c9-ba9c-a0fe8eefd262 req-67c8d242-75c8-4c13-b55d-e6922a3ed9fe service nova] Acquiring lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1215f623-40c6-47c9-ba9c-a0fe8eefd262 req-67c8d242-75c8-4c13-b55d-e6922a3ed9fe service nova] Acquired lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG nova.network.neutron [req-1215f623-40c6-47c9-ba9c-a0fe8eefd262 req-67c8d242-75c8-4c13-b55d-e6922a3ed9fe service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Refreshing network info cache for port 3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "c606772c-d1ed-415e-84f4-129319bb3865" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:21:27 user nova-compute[71364]: INFO nova.compute.manager [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Detaching volume 3124c49b-2f09-41c8-8965-a0e4266f053c
Apr 11 22:21:27 user nova-compute[71364]: INFO nova.virt.block_device [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Attempting to driver detach volume 3124c49b-2f09-41c8-8965-a0e4266f053c from mountpoint /dev/vdb
Apr 11 22:21:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Attempting to detach device vdb from instance c606772c-d1ed-415e-84f4-129319bb3865 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:21:27 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:21:27 user nova-compute[71364]:   <source dev="/dev/sdc"/>
Apr 11 22:21:27 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:21:27 user nova-compute[71364]:   <serial>3124c49b-2f09-41c8-8965-a0e4266f053c</serial>
Apr 11 22:21:27 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 22:21:27 user nova-compute[71364]: </disk>
Apr 11 22:21:27 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:21:27 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Successfully detached device vdb from instance c606772c-d1ed-415e-84f4-129319bb3865 from the persistent domain config.
Apr 11 22:21:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c606772c-d1ed-415e-84f4-129319bb3865 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:21:27 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:21:27 user nova-compute[71364]:   <source dev="/dev/sdc"/>
Apr 11 22:21:27 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:21:27 user nova-compute[71364]:   <serial>3124c49b-2f09-41c8-8965-a0e4266f053c</serial>
Apr 11 22:21:27 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 11 22:21:27 user nova-compute[71364]: </disk>
Apr 11 22:21:27 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681251687.8543942, c606772c-d1ed-415e-84f4-129319bb3865 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c606772c-d1ed-415e-84f4-129319bb3865 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:21:27 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Successfully detached device vdb from instance c606772c-d1ed-415e-84f4-129319bb3865 from the live domain config.
Apr 11 22:21:27 user nova-compute[71364]: DEBUG nova.network.neutron [req-1215f623-40c6-47c9-ba9c-a0fe8eefd262 req-67c8d242-75c8-4c13-b55d-e6922a3ed9fe service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updated VIF entry in instance network info cache for port 3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG nova.network.neutron [req-1215f623-40c6-47c9-ba9c-a0fe8eefd262 req-67c8d242-75c8-4c13-b55d-e6922a3ed9fe service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updating instance_info_cache with network_info: [{"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zRZMhypJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:21:27 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:21:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1215f623-40c6-47c9-ba9c-a0fe8eefd262 req-67c8d242-75c8-4c13-b55d-e6922a3ed9fe service nova] Releasing lock "refresh_cache-c606772c-d1ed-415e-84f4-129319bb3865" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[617fdecd-e05b-4401-a8e5-e4073ecf67b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:21:27 user nova-compute[71364]: No targets found.
Apr 11 22:21:27 user nova-compute[71364]: iSNS:
Apr 11 22:21:27 user nova-compute[71364]: No targets found.
Apr 11 22:21:27 user nova-compute[71364]: STATIC:
Apr 11 22:21:27 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96
Apr 11 22:21:27 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:21:27 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:21:27 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c
Apr 11 22:21:27 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:21:27 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:21:27 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758
Apr 11 22:21:27 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:21:27 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:21:27 user nova-compute[71364]: FIRMWARE:
Apr 11 22:21:27 user nova-compute[71364]: No targets found.
Apr 11 22:21:27 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:21:27 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:21:27 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4964dc19-f622-413a-a89d-5801a0535f16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb91da69-09e9-4300-ac0f-5653712665e1]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:21:27 user nova-compute[71364]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)
Apr 11 22:21:27 user nova-compute[71364]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 (non-flash)
Apr 11 22:21:27 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:21:27 user nova-compute[71364]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c (non-flash)
Apr 11 22:21:27 user nova-compute[71364]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 (non-flash)
Apr 11 22:21:27 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bff7a0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c'): ({'sdc'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Removing single pathed devices sdc {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ff08da-932e-4b81-b79c-05973e4aa041]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1a29a5-9412-467f-ab3d-7e7f2314e803]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Flushing IO for device /dev/sdc {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:21:27 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8848db-5ed1-4cb4-9c63-909c858da501]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae28da7-5db0-4f06-bb60-dd3d30ab21d4]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df1a1be-c5ef-4d7e-845b-905e5f0c1835]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4c8128-6212-47e5-ad9c-c7755f624874]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260]
Apr 11 22:21:28 user nova-compute[71364]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c, portal: 172.16.0.220,3260] successful.
Apr 11 22:21:28 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3124c49b-2f09-41c8-8965-a0e4266f053c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ef835b-fcfb-4c98-b415-9bd3fb60c69e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] <== disconnect_volume: return (320ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "5561da61-cae9-4365-83bc-923ab7b3a439" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "5561da61-cae9-4365-83bc-923ab7b3a439" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:21:28 user nova-compute[71364]: INFO nova.compute.manager [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Terminating instance
Apr 11 22:21:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG nova.compute.manager [req-8f96b219-5599-44ac-a72e-4e07365e152c req-cbfd791a-f749-46b4-87ad-f18ec3326940 service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Received event network-vif-unplugged-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8f96b219-5599-44ac-a72e-4e07365e152c req-cbfd791a-f749-46b4-87ad-f18ec3326940 service nova] Acquiring lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8f96b219-5599-44ac-a72e-4e07365e152c req-cbfd791a-f749-46b4-87ad-f18ec3326940 service nova] Lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8f96b219-5599-44ac-a72e-4e07365e152c req-cbfd791a-f749-46b4-87ad-f18ec3326940 service nova] Lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG nova.compute.manager [req-8f96b219-5599-44ac-a72e-4e07365e152c req-cbfd791a-f749-46b4-87ad-f18ec3326940 service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] No waiting events found dispatching network-vif-unplugged-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG nova.compute.manager [req-8f96b219-5599-44ac-a72e-4e07365e152c req-cbfd791a-f749-46b4-87ad-f18ec3326940 service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Received event network-vif-unplugged-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG nova.objects.instance [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'flavor' on Instance uuid c606772c-d1ed-415e-84f4-129319bb3865 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "c606772c-d1ed-415e-84f4-129319bb3865" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.881s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:29 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Instance destroyed successfully.
Apr 11 22:21:29 user nova-compute[71364]: DEBUG nova.objects.instance [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lazy-loading 'resources' on Instance uuid 5561da61-cae9-4365-83bc-923ab7b3a439 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:19:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-521483110',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-521483110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-521483110',id=42,image_ref='4e9d3308-18ec-4f90-a852-f730bdb45f15',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:19:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-x00ga654',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1208917682',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:19:55Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=5561da61-cae9-4365-83bc-923ab7b3a439,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "address": "fa:16:3e:bb:97:6e", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8dcbc9c-53", "ovs_interfaceid": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "address": "fa:16:3e:bb:97:6e", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8dcbc9c-53", "ovs_interfaceid": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:97:6e,bridge_name='br-int',has_traffic_filtering=True,id=a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8dcbc9c-53') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_vif [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:97:6e,bridge_name='br-int',has_traffic_filtering=True,id=a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8dcbc9c-53') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8dcbc9c-53, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:21:29 user nova-compute[71364]: INFO os_vif [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:97:6e,bridge_name='br-int',has_traffic_filtering=True,id=a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8dcbc9c-53')
Apr 11 22:21:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JwKBSjIM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:21:29 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f981843-812b-485e-aedd-1c5e7c49385e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:21:29 user nova-compute[71364]: No targets found.
Apr 11 22:21:29 user nova-compute[71364]: iSNS:
Apr 11 22:21:29 user nova-compute[71364]: No targets found.
Apr 11 22:21:29 user nova-compute[71364]: STATIC:
Apr 11 22:21:29 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96
Apr 11 22:21:29 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:21:29 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:21:29 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758
Apr 11 22:21:29 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:21:29 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:21:29 user nova-compute[71364]: FIRMWARE:
Apr 11 22:21:29 user nova-compute[71364]: No targets found.
Apr 11 22:21:29 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:21:29 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:21:29 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7852b7d9-b437-4450-b84b-1559cdda7e53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a59c312-756b-40c3-b013-1e4cd3c99fee]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:21:29 user nova-compute[71364]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 (non-flash)
Apr 11 22:21:29 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:21:29 user nova-compute[71364]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 (non-flash)
Apr 11 22:21:29 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacf93130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96'): ({'sdd'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Removing single pathed devices sdd {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bd7f21-b11c-47b8-98fd-f84f4360abf7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c823f62-6ac1-4c2b-9df7-c10550d667e9]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flushing IO for device /dev/sdd {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[744652a2-3702-4a0a-aacf-6d09c0bb446e]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ff249d-e477-4a0a-ba56-cbdee195fd59]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] SCSI volumes sdd have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOa5638c55-46d2a77ecc6b4f6d', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a5638c55', '/dev/disk/by-id/scsi-23436643261373765') {{(pid=81576) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6780eb94-7961-4a40-8102-15487a845bdf]: (4, None) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13a2cb5-197c-4666-8a98-b90fb34bcfe8]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e954860e-2b13-4582-ad3e-16ddfc7f533d]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96, portal: 172.16.0.220,3260]
Apr 11 22:21:29 user nova-compute[71364]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96, portal: 172.16.0.220,3260] successful.
Apr 11 22:21:29 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8fe4b31-b103-468b-b494-eebee0ccad96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4a90f3-2984-49bc-93d1-184dace72605]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== disconnect_volume: return (298ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:21:29 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Deleting instance files /opt/stack/data/nova/instances/5561da61-cae9-4365-83bc-923ab7b3a439_del
Apr 11 22:21:29 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Deletion of /opt/stack/data/nova/instances/5561da61-cae9-4365-83bc-923ab7b3a439_del complete
Apr 11 22:21:29 user nova-compute[71364]: INFO nova.compute.manager [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Took 1.13 seconds to destroy the instance on the hypervisor.
Apr 11 22:21:29 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:21:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:30 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:21:30 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Took 0.47 seconds to deallocate network for instance.
Apr 11 22:21:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-964e5eca-c28f-4a90-a592-012df994bab3 req-156a0803-1476-45a9-ae10-20bae8544f9a service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Received event network-vif-plugged-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:21:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-964e5eca-c28f-4a90-a592-012df994bab3 req-156a0803-1476-45a9-ae10-20bae8544f9a service nova] Acquiring lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:21:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-964e5eca-c28f-4a90-a592-012df994bab3 req-156a0803-1476-45a9-ae10-20bae8544f9a service nova] Lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:21:30 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-964e5eca-c28f-4a90-a592-012df994bab3 req-156a0803-1476-45a9-ae10-20bae8544f9a service nova] Lock "5561da61-cae9-4365-83bc-923ab7b3a439-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:21:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-964e5eca-c28f-4a90-a592-012df994bab3 req-156a0803-1476-45a9-ae10-20bae8544f9a service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] No waiting events found dispatching network-vif-plugged-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:21:30 user nova-compute[71364]: WARNING nova.compute.manager [req-964e5eca-c28f-4a90-a592-012df994bab3 req-156a0803-1476-45a9-ae10-20bae8544f9a service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Received unexpected event network-vif-plugged-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 for instance with vm_state active and task_state deleting.
Apr 11 22:21:30 user nova-compute[71364]: DEBUG nova.compute.manager [req-964e5eca-c28f-4a90-a592-012df994bab3 req-156a0803-1476-45a9-ae10-20bae8544f9a service nova] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Received event network-vif-deleted-a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:21:31 user nova-compute[71364]: INFO nova.compute.manager [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Took 0.78 seconds to detach 1 volumes for instance.
Apr 11 22:21:31 user nova-compute[71364]: DEBUG nova.compute.manager [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Deleting volume: d8fe4b31-b103-468b-b494-eebee0ccad96 {{(pid=71364) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 22:21:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:21:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:21:31 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:21:31 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:21:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:21:31 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Deleted allocations for instance 5561da61-cae9-4365-83bc-923ab7b3a439
Apr 11 22:21:31 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "5561da61-cae9-4365-83bc-923ab7b3a439" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.811s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:21:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-bf10562e-bcdd-455c-9aec-d22692a3da8e req-06734051-21d5-4845-95f0-0aa2b978e0f1 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received event network-changed-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:21:37 user nova-compute[71364]: DEBUG nova.compute.manager [req-bf10562e-bcdd-455c-9aec-d22692a3da8e req-06734051-21d5-4845-95f0-0aa2b978e0f1 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Refreshing instance network info cache due to event network-changed-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:21:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bf10562e-bcdd-455c-9aec-d22692a3da8e req-06734051-21d5-4845-95f0-0aa2b978e0f1 service nova] Acquiring lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:21:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bf10562e-bcdd-455c-9aec-d22692a3da8e req-06734051-21d5-4845-95f0-0aa2b978e0f1 service nova] Acquired lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:21:37 user nova-compute[71364]: DEBUG nova.network.neutron [req-bf10562e-bcdd-455c-9aec-d22692a3da8e req-06734051-21d5-4845-95f0-0aa2b978e0f1 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Refreshing network info cache for port b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:21:37 user nova-compute[71364]: DEBUG nova.network.neutron [req-bf10562e-bcdd-455c-9aec-d22692a3da8e req-06734051-21d5-4845-95f0-0aa2b978e0f1 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updated VIF entry in instance network info cache for port b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:21:37 user nova-compute[71364]: DEBUG nova.network.neutron [req-bf10562e-bcdd-455c-9aec-d22692a3da8e req-06734051-21d5-4845-95f0-0aa2b978e0f1 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updating instance_info_cache with network_info: [{"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:21:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bf10562e-bcdd-455c-9aec-d22692a3da8e req-06734051-21d5-4845-95f0-0aa2b978e0f1 service nova] Releasing lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:21:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:21:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:21:39 user nova-compute[71364]: INFO nova.compute.manager [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Shelving
Apr 11 22:21:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:40 user nova-compute[71364]: DEBUG nova.compute.manager [req-1a9dc711-7303-458c-800a-5e582011991d req-f866e237-882d-4bd1-a6e9-103bf37587d7 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received event network-vif-unplugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:21:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a9dc711-7303-458c-800a-5e582011991d req-f866e237-882d-4bd1-a6e9-103bf37587d7 service nova] Acquiring lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:21:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a9dc711-7303-458c-800a-5e582011991d req-f866e237-882d-4bd1-a6e9-103bf37587d7 service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:21:40 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1a9dc711-7303-458c-800a-5e582011991d req-f866e237-882d-4bd1-a6e9-103bf37587d7 service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:21:40 user nova-compute[71364]: DEBUG nova.compute.manager [req-1a9dc711-7303-458c-800a-5e582011991d req-f866e237-882d-4bd1-a6e9-103bf37587d7 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] No waiting events found dispatching network-vif-unplugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:21:40 user nova-compute[71364]: WARNING nova.compute.manager [req-1a9dc711-7303-458c-800a-5e582011991d req-f866e237-882d-4bd1-a6e9-103bf37587d7 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received unexpected event network-vif-unplugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance with vm_state active and task_state shelving.
Apr 11 22:21:40 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Instance destroyed successfully.
Apr 11 22:21:40 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Beginning cold snapshot process
Apr 11 22:21:40 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 22:21:40 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk /opt/stack/data/nova/instances/snapshots/tmpctgv9gcc/fed3700663c34f54a177b801bc9a535a {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:21:41 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk /opt/stack/data/nova/instances/snapshots/tmpctgv9gcc/fed3700663c34f54a177b801bc9a535a" returned: 0 in 0.363s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:21:41 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Snapshot extracted, beginning image upload
Apr 11 22:21:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-b78e4afa-df12-460b-b818-7b5f5de7c254 req-e87edd1d-1364-4079-a67b-33acdbe6461f service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received event network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:21:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b78e4afa-df12-460b-b818-7b5f5de7c254 req-e87edd1d-1364-4079-a67b-33acdbe6461f service nova] Acquiring lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:21:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b78e4afa-df12-460b-b818-7b5f5de7c254 req-e87edd1d-1364-4079-a67b-33acdbe6461f service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:21:42 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b78e4afa-df12-460b-b818-7b5f5de7c254 req-e87edd1d-1364-4079-a67b-33acdbe6461f service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:21:42 user nova-compute[71364]: DEBUG nova.compute.manager [req-b78e4afa-df12-460b-b818-7b5f5de7c254 req-e87edd1d-1364-4079-a67b-33acdbe6461f service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] No waiting events found dispatching network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:21:42 user nova-compute[71364]: WARNING nova.compute.manager [req-b78e4afa-df12-460b-b818-7b5f5de7c254 req-e87edd1d-1364-4079-a67b-33acdbe6461f service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received unexpected event network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance with vm_state active and task_state shelving_image_uploading.
Apr 11 22:21:43 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Snapshot image upload complete
Apr 11 22:21:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:21:43 user nova-compute[71364]: INFO nova.compute.manager [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Shelve offloading
Apr 11 22:21:43 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Instance destroyed successfully.
Apr 11 22:21:43 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:21:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:21:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquired lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:21:43 user nova-compute[71364]: DEBUG nova.network.neutron [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:21:43 user nova-compute[71364]: DEBUG nova.network.neutron [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updating instance_info_cache with network_info: [{"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:21:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Releasing lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:21:44 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Instance destroyed successfully.
Apr 11 22:21:44 user nova-compute[71364]: DEBUG nova.objects.instance [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'resources' on Instance uuid 3879bb47-6592-4d9d-9e3c-fbbfc688335e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1104269846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1104269846',id=43,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9ha7w4Yx2Ct4yNyWAG+y2X1fGRwyualBpBeukX0mkbXyGthnVwMyhQhZxUhJmIzxFqpZJ/5uqBRNCMtZuCVp7UVwu5uwMc/x/kd2EHdYmC74j0KpKixiMzFdJ8OyMPZg==',key_name='tempest-keypair-75772273',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:19:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='29e79d7c2e144af59f911973e79ba110',ramdisk_id='',reservation_id='r-49yyiiel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-590407943',owner_user_name='tempest-AttachVolumeShelveTestJSON-590407943-project-member',shelved_at='2023-04-11T22:21:43.098089',shelved_host='user',shelved_image_id='1cf0d15b-af64-4121-8786-cca00f2f2293'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:21:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5898621881a4e799df121e1d5957f42',uuid=3879bb47-6592-4d9d-9e3c-fbbfc688335e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converting VIF {"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4da2fe7-4f') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG os_vif [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4da2fe7-4f') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4da2fe7-4f, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:21:44 user nova-compute[71364]: INFO os_vif [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4da2fe7-4f')
Apr 11 22:21:44 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Deleting instance files /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e_del
Apr 11 22:21:44 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Deletion of /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e_del complete
Apr 11 22:21:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-31ed89db-15da-4e12-af01-6edb0ebdf349 req-b76a05e3-dd1c-497c-afea-9c358b719f0e service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received event network-changed-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG nova.compute.manager [req-31ed89db-15da-4e12-af01-6edb0ebdf349 req-b76a05e3-dd1c-497c-afea-9c358b719f0e service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Refreshing instance network info cache due to event network-changed-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-31ed89db-15da-4e12-af01-6edb0ebdf349 req-b76a05e3-dd1c-497c-afea-9c358b719f0e service nova] Acquiring lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-31ed89db-15da-4e12-af01-6edb0ebdf349 req-b76a05e3-dd1c-497c-afea-9c358b719f0e service nova] Acquired lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG nova.network.neutron [req-31ed89db-15da-4e12-af01-6edb0ebdf349 req-b76a05e3-dd1c-497c-afea-9c358b719f0e service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Refreshing network info cache for port b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:21:44 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Deleted allocations for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e
Apr 11 22:21:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG nova.objects.instance [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'numa_topology' on Instance uuid 3879bb47-6592-4d9d-9e3c-fbbfc688335e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251689.359076, 5561da61-cae9-4365-83bc-923ab7b3a439 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:21:44 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] VM Stopped (Lifecycle Event)
Apr 11 22:21:44 user nova-compute[71364]: DEBUG nova.compute.manager [None req-7744b31d-e0d3-4674-b8db-3ecec3ab37e7 None None] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 4.766s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG nova.network.neutron [req-31ed89db-15da-4e12-af01-6edb0ebdf349 req-b76a05e3-dd1c-497c-afea-9c358b719f0e service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updated VIF entry in instance network info cache for port b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG nova.network.neutron [req-31ed89db-15da-4e12-af01-6edb0ebdf349 req-b76a05e3-dd1c-497c-afea-9c358b719f0e service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updating instance_info_cache with network_info: [{"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-31ed89db-15da-4e12-af01-6edb0ebdf349 req-b76a05e3-dd1c-497c-afea-9c358b719f0e service nova] Releasing lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:21:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:21:55 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251700.4473822, 3879bb47-6592-4d9d-9e3c-fbbfc688335e => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:21:55 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] VM Stopped (Lifecycle Event)
Apr 11 22:21:55 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0e0c52d3-b3fe-453c-9f31-732fe58c6bba None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:21:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:22:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:22:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:22:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:22:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:22:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:22:12 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:22:12 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:22:12 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8596MB free_disk=26.102684020996094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance c606772c-d1ed-415e-84f4-129319bb3865 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 6c682755-7a09-4872-8be2-c429ced2debe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:22:12 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:22:13 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:22:13 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:22:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:22:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:14 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:22:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "c606772c-d1ed-415e-84f4-129319bb3865" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:22:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:22:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:22:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:22:18 user nova-compute[71364]: INFO nova.compute.manager [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Terminating instance
Apr 11 22:22:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:22:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG nova.compute.manager [req-4132e8a5-b67c-4766-bd70-44424a82a0d2 req-6c77d831-88f0-40ab-ad14-730167272bab service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-vif-unplugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4132e8a5-b67c-4766-bd70-44424a82a0d2 req-6c77d831-88f0-40ab-ad14-730167272bab service nova] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4132e8a5-b67c-4766-bd70-44424a82a0d2 req-6c77d831-88f0-40ab-ad14-730167272bab service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-4132e8a5-b67c-4766-bd70-44424a82a0d2 req-6c77d831-88f0-40ab-ad14-730167272bab service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG nova.compute.manager [req-4132e8a5-b67c-4766-bd70-44424a82a0d2 req-6c77d831-88f0-40ab-ad14-730167272bab service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] No waiting events found dispatching network-vif-unplugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG nova.compute.manager [req-4132e8a5-b67c-4766-bd70-44424a82a0d2 req-6c77d831-88f0-40ab-ad14-730167272bab service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-vif-unplugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:19 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Instance destroyed successfully.
Apr 11 22:22:19 user nova-compute[71364]: DEBUG nova.objects.instance [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'resources' on Instance uuid c606772c-d1ed-415e-84f4-129319bb3865 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-607364897',display_name='tempest-TestMinimumBasicScenario-server-607364897',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-607364897',id=40,image_ref='13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0E6IW8IC9c9o4usL7v07yI/kkM/pJZNoOtLq6Y9s00xPpXz5e2WgJ8kun4/vc867GqTIrNUz+IIntx6J933ixpIdIU86aX7qU0WxlLh+Lwh+w1WRuI+adzdp2SaCNM3Q==',key_name='tempest-TestMinimumBasicScenario-2097245857',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c29da1948d84b08acbb7893db590608',ramdisk_id='',reservation_id='r-0xdd1no4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1414513068',owner_user_name='tempest-TestMinimumBasicScenario-1414513068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:19:42Z,user_data=None,user_id='e0e3f97050c448deba7ed9dbe0657c77',uuid=c606772c-d1ed-415e-84f4-129319bb3865,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converting VIF {"id": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "address": "fa:16:3e:8b:11:ea", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ae4d6b9-6e", "ovs_interfaceid": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:11:ea,bridge_name='br-int',has_traffic_filtering=True,id=3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae4d6b9-6e') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG os_vif [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:11:ea,bridge_name='br-int',has_traffic_filtering=True,id=3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae4d6b9-6e') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ae4d6b9-6e, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:22:19 user nova-compute[71364]: INFO os_vif [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:11:ea,bridge_name='br-int',has_traffic_filtering=True,id=3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ae4d6b9-6e')
Apr 11 22:22:19 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Deleting instance files /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865_del
Apr 11 22:22:19 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Deletion of /opt/stack/data/nova/instances/c606772c-d1ed-415e-84f4-129319bb3865_del complete
Apr 11 22:22:19 user nova-compute[71364]: INFO nova.compute.manager [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 11 22:22:19 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:22:19 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: c606772c-d1ed-415e-84f4-129319bb3865] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:22:20 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Took 0.49 seconds to deallocate network for instance.
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "6c682755-7a09-4872-8be2-c429ced2debe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "6c682755-7a09-4872-8be2-c429ced2debe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "6c682755-7a09-4872-8be2-c429ced2debe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "6c682755-7a09-4872-8be2-c429ced2debe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "6c682755-7a09-4872-8be2-c429ced2debe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:22:20 user nova-compute[71364]: INFO nova.compute.manager [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Terminating instance
Apr 11 22:22:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:22:20 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Deleted allocations for instance c606772c-d1ed-415e-84f4-129319bb3865
Apr 11 22:22:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "c606772c-d1ed-415e-84f4-129319bb3865" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.660s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-93554c67-48ca-4eeb-9597-0311960205ed req-c6c1cde5-b6fe-4f2f-904d-f09961d30b8c service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Received event network-vif-unplugged-b7d928c8-122d-48cb-a4e1-916a12301d5b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-93554c67-48ca-4eeb-9597-0311960205ed req-c6c1cde5-b6fe-4f2f-904d-f09961d30b8c service nova] Acquiring lock "6c682755-7a09-4872-8be2-c429ced2debe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-93554c67-48ca-4eeb-9597-0311960205ed req-c6c1cde5-b6fe-4f2f-904d-f09961d30b8c service nova] Lock "6c682755-7a09-4872-8be2-c429ced2debe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-93554c67-48ca-4eeb-9597-0311960205ed req-c6c1cde5-b6fe-4f2f-904d-f09961d30b8c service nova] Lock "6c682755-7a09-4872-8be2-c429ced2debe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-93554c67-48ca-4eeb-9597-0311960205ed req-c6c1cde5-b6fe-4f2f-904d-f09961d30b8c service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] No waiting events found dispatching network-vif-unplugged-b7d928c8-122d-48cb-a4e1-916a12301d5b {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:22:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-93554c67-48ca-4eeb-9597-0311960205ed req-c6c1cde5-b6fe-4f2f-904d-f09961d30b8c service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Received event network-vif-unplugged-b7d928c8-122d-48cb-a4e1-916a12301d5b for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:22:20 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Instance destroyed successfully.
Apr 11 22:22:20 user nova-compute[71364]: DEBUG nova.objects.instance [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lazy-loading 'resources' on Instance uuid 6c682755-7a09-4872-8be2-c429ced2debe {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:17:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1471432587',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1471432587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1471432587',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:17:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-86scabjy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:17:55Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=6c682755-7a09-4872-8be2-c429ced2debe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "address": "fa:16:3e:22:7a:fd", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d928c8-12", "ovs_interfaceid": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "address": "fa:16:3e:22:7a:fd", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d928c8-12", "ovs_interfaceid": "b7d928c8-122d-48cb-a4e1-916a12301d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:7a:fd,bridge_name='br-int',has_traffic_filtering=True,id=b7d928c8-122d-48cb-a4e1-916a12301d5b,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d928c8-12') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_vif [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:7a:fd,bridge_name='br-int',has_traffic_filtering=True,id=b7d928c8-122d-48cb-a4e1-916a12301d5b,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d928c8-12') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7d928c8-12, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:22:21 user nova-compute[71364]: INFO os_vif [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:7a:fd,bridge_name='br-int',has_traffic_filtering=True,id=b7d928c8-122d-48cb-a4e1-916a12301d5b,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d928c8-12')
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JtAkshSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:22:21 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Skipping network cache update for instance because it is being deleted. {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9841}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[666b27b7-9adc-448c-ba57-4b5d251dde86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:22:21 user nova-compute[71364]: No targets found.
Apr 11 22:22:21 user nova-compute[71364]: iSNS:
Apr 11 22:22:21 user nova-compute[71364]: No targets found.
Apr 11 22:22:21 user nova-compute[71364]: STATIC:
Apr 11 22:22:21 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758
Apr 11 22:22:21 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:22:21 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:22:21 user nova-compute[71364]: FIRMWARE:
Apr 11 22:22:21 user nova-compute[71364]: No targets found.
Apr 11 22:22:21 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:22:21 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:22:21 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.compute.manager [req-2b35fb14-a7e6-4315-ac8a-31c2fca0875c req-29201f62-86ca-4306-b970-ca09ed807d56 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2b35fb14-a7e6-4315-ac8a-31c2fca0875c req-29201f62-86ca-4306-b970-ca09ed807d56 service nova] Acquiring lock "c606772c-d1ed-415e-84f4-129319bb3865-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2b35fb14-a7e6-4315-ac8a-31c2fca0875c req-29201f62-86ca-4306-b970-ca09ed807d56 service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2b35fb14-a7e6-4315-ac8a-31c2fca0875c req-29201f62-86ca-4306-b970-ca09ed807d56 service nova] Lock "c606772c-d1ed-415e-84f4-129319bb3865-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.compute.manager [req-2b35fb14-a7e6-4315-ac8a-31c2fca0875c req-29201f62-86ca-4306-b970-ca09ed807d56 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] No waiting events found dispatching network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:22:21 user nova-compute[71364]: WARNING nova.compute.manager [req-2b35fb14-a7e6-4315-ac8a-31c2fca0875c req-29201f62-86ca-4306-b970-ca09ed807d56 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received unexpected event network-vif-plugged-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance with vm_state deleted and task_state None.
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.compute.manager [req-2b35fb14-a7e6-4315-ac8a-31c2fca0875c req-29201f62-86ca-4306-b970-ca09ed807d56 service nova] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Received event network-vif-deleted-3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe63fdb7-f6c5-4e59-87f7-b3d961b5f875]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04a9578-0e56-4780-8913-8aab2c137372]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:22:21 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 (non-flash)
Apr 11 22:22:21 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacb6a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2592b88a-17d7-49ad-b3b6-bc4cd1397341]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Skipping network cache update for instance because it has been migrated to another host. {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Didn't find any instances for network info cache update. {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00e1db3-5495-44be-82da-58ca141dbc05]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[47be5fdd-3bee-42c5-89dc-4b2c8cdcb6e5]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a7130f-de73-4b92-96d7-db365af17105]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b37fce3-95a7-4ad8-8d93-976af93c1b5d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e23555-c1dd-42ba-935c-6279dab9951f]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758, portal: 172.16.0.220,3260]
Apr 11 22:22:21 user nova-compute[71364]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758, portal: 172.16.0.220,3260] successful.
Apr 11 22:22:21 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d835ec35-c1e9-466e-a602-8e96296dd758 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f4c464-fc5f-4bdf-8c22-fca6ba40b2fd]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== disconnect_volume: return (292ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:22:21 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Deleting instance files /opt/stack/data/nova/instances/6c682755-7a09-4872-8be2-c429ced2debe_del
Apr 11 22:22:21 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Deletion of /opt/stack/data/nova/instances/6c682755-7a09-4872-8be2-c429ced2debe_del complete
Apr 11 22:22:21 user nova-compute[71364]: INFO nova.compute.manager [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 11 22:22:21 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:22:21 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:22:21 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Took 0.46 seconds to deallocate network for instance.
Apr 11 22:22:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-e065a462-751c-4b87-ae95-9bf7ede765c8 req-5b4d5dd6-4739-401f-948b-c0fe7a2daaab service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Received event network-vif-plugged-b7d928c8-122d-48cb-a4e1-916a12301d5b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:22:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e065a462-751c-4b87-ae95-9bf7ede765c8 req-5b4d5dd6-4739-401f-948b-c0fe7a2daaab service nova] Acquiring lock "6c682755-7a09-4872-8be2-c429ced2debe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:22:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e065a462-751c-4b87-ae95-9bf7ede765c8 req-5b4d5dd6-4739-401f-948b-c0fe7a2daaab service nova] Lock "6c682755-7a09-4872-8be2-c429ced2debe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:22:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e065a462-751c-4b87-ae95-9bf7ede765c8 req-5b4d5dd6-4739-401f-948b-c0fe7a2daaab service nova] Lock "6c682755-7a09-4872-8be2-c429ced2debe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:22:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-e065a462-751c-4b87-ae95-9bf7ede765c8 req-5b4d5dd6-4739-401f-948b-c0fe7a2daaab service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] No waiting events found dispatching network-vif-plugged-b7d928c8-122d-48cb-a4e1-916a12301d5b {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:22:22 user nova-compute[71364]: WARNING nova.compute.manager [req-e065a462-751c-4b87-ae95-9bf7ede765c8 req-5b4d5dd6-4739-401f-948b-c0fe7a2daaab service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Received unexpected event network-vif-plugged-b7d928c8-122d-48cb-a4e1-916a12301d5b for instance with vm_state active and task_state deleting.
Apr 11 22:22:22 user nova-compute[71364]: INFO nova.compute.manager [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Took 0.74 seconds to detach 1 volumes for instance.
Apr 11 22:22:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Deleting volume: d835ec35-c1e9-466e-a602-8e96296dd758 {{(pid=71364) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 11 22:22:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:22:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:22:22 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:22:22 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:22:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:22:23 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Deleted allocations for instance 6c682755-7a09-4872-8be2-c429ced2debe
Apr 11 22:22:23 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:22:23 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:22:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:22:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "6c682755-7a09-4872-8be2-c429ced2debe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.892s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:22:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-df6698c9-5734-44c0-89cc-53d76caf2b74 req-45f43147-7a8a-49d1-ac9f-c3a20946484d service nova] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Received event network-vif-deleted-b7d928c8-122d-48cb-a4e1-916a12301d5b {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:22:25 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:22:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:22:34 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251739.4879732, c606772c-d1ed-415e-84f4-129319bb3865 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:22:34 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: c606772c-d1ed-415e-84f4-129319bb3865] VM Stopped (Lifecycle Event)
Apr 11 22:22:34 user nova-compute[71364]: DEBUG nova.compute.manager [None req-29081a99-f28e-4830-98c4-f5c8b5a68e5b None None] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:22:35 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251740.9803133, 6c682755-7a09-4872-8be2-c429ced2debe => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:22:35 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] VM Stopped (Lifecycle Event)
Apr 11 22:22:36 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1d11015a-9b92-4bcd-b948-4bfac64341f8 None None] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:22:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:22:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:22:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:22:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:22:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:22:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:22:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:22:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:23:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:23:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:23:12 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:23:12 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=26.13629150390625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.063s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:23:12 user nova-compute[71364]: INFO nova.compute.claims [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Claim successful on node user
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.183s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:23:12 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:23:12 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG nova.policy [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:23:13 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Creating image(s)
Apr 11 22:23:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "/opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "/opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "/opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "e7cc7f8e794c6f2ce6f87044e7d9f857d646031e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "e7cc7f8e794c6f2ce6f87044e7d9f857d646031e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e.part --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e.part --force-share --output=json" returned: 0 in 0.144s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG nova.virt.images [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 5ebaba51-1209-4bc5-94bd-4d311bd19dd2 was qcow2, converting to raw {{(pid=71364) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e.part /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e.converted {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e.part /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e.converted" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e.converted --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e.converted --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "e7cc7f8e794c6f2ce6f87044e7d9f857d646031e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.777s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Successfully created port: 53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "e7cc7f8e794c6f2ce6f87044e7d9f857d646031e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "e7cc7f8e794c6f2ce6f87044e7d9f857d646031e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e,backing_fmt=raw /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e,backing_fmt=raw /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk 1073741824" returned: 0 in 0.063s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "e7cc7f8e794c6f2ce6f87044e7d9f857d646031e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e --force-share --output=json" returned: 0 in 0.147s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk. size=1073741824 {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG nova.virt.disk.api [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Cannot resize image /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk to a smaller size. {{(pid=71364) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG nova.objects.instance [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'migration_context' on Instance uuid a41689a7-1c45-45b8-8f75-c3f0a655cc18 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Ensure instance console log exists: /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:14 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Successfully updated port: 53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquired lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-eaba093d-e126-4457-8446-e37f0902167c req-f092b718-1a73-458d-9104-165b1264ad73 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-changed-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-eaba093d-e126-4457-8446-e37f0902167c req-f092b718-1a73-458d-9104-165b1264ad73 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Refreshing instance network info cache due to event network-changed-53fb131a-4441-4893-8296-1e9ba3a4eef5. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-eaba093d-e126-4457-8446-e37f0902167c req-f092b718-1a73-458d-9104-165b1264ad73 service nova] Acquiring lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.network.neutron [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updating instance_info_cache with network_info: [{"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Releasing lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Instance network_info: |[{"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-eaba093d-e126-4457-8446-e37f0902167c req-f092b718-1a73-458d-9104-165b1264ad73 service nova] Acquired lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.network.neutron [req-eaba093d-e126-4457-8446-e37f0902167c req-f092b718-1a73-458d-9104-165b1264ad73 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Refreshing network info cache for port 53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Start _get_guest_xml network_info=[{"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T22:23:10Z,direct_url=<?>,disk_format='qcow2',id=5ebaba51-1209-4bc5-94bd-4d311bd19dd2,min_disk=0,min_ram=0,name='tempest-scenario-img--215345498',owner='8c29da1948d84b08acbb7893db590608',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T22:23:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': '5ebaba51-1209-4bc5-94bd-4d311bd19dd2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "077c4c00-d46b-4d3f-8a17-22b2f0755149" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "077c4c00-d46b-4d3f-8a17-22b2f0755149" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:23:15 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:23:15 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-11T22:23:10Z,direct_url=<?>,disk_format='qcow2',id=5ebaba51-1209-4bc5-94bd-4d311bd19dd2,min_disk=0,min_ram=0,name='tempest-scenario-img--215345498',owner='8c29da1948d84b08acbb7893db590608',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-11T22:23:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:23:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-886613326',display_name='tempest-TestMinimumBasicScenario-server-886613326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-886613326',id=44,image_ref='5ebaba51-1209-4bc5-94bd-4d311bd19dd2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLozpT3IVZpFExpqfZ7nWUmsdEQItZHyQVVZzd6wLHQO8XxFS1K2UtCfzqkj67b1mp4lxFDqCmYwQtfgNsNcOcp7JePHFi8MHbM5gfUCCTbQPZaZ7X9hbwKeBgtQjQMuJg==',key_name='tempest-TestMinimumBasicScenario-1734169471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c29da1948d84b08acbb7893db590608',ramdisk_id='',reservation_id='r-cwqcq449',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ebaba51-1209-4bc5-94bd-4d311bd19dd2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1414513068',owner_user_name='tempest-TestMinimumBasicScenario-1414513068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:23:13Z,user_data=None,user_id='e0e3f97050c448deba7ed9dbe0657c77',uuid=a41689a7-1c45-45b8-8f75-c3f0a655cc18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converting VIF {"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:fd:82,bridge_name='br-int',has_traffic_filtering=True,id=53fb131a-4441-4893-8296-1e9ba3a4eef5,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fb131a-44') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.objects.instance [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'pci_devices' on Instance uuid a41689a7-1c45-45b8-8f75-c3f0a655cc18 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:23:15 user nova-compute[71364]:   <uuid>a41689a7-1c45-45b8-8f75-c3f0a655cc18</uuid>
Apr 11 22:23:15 user nova-compute[71364]:   <name>instance-0000002c</name>
Apr 11 22:23:15 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:23:15 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:23:15 user nova-compute[71364]:   <metadata>
Apr 11 22:23:15 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:23:15 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:23:15 user nova-compute[71364]:       <nova:name>tempest-TestMinimumBasicScenario-server-886613326</nova:name>
Apr 11 22:23:15 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:23:15</nova:creationTime>
Apr 11 22:23:15 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:23:15 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:23:15 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:23:15 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:23:15 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:23:15 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:23:15 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:23:15 user nova-compute[71364]:       <nova:owner>
Apr 11 22:23:15 user nova-compute[71364]:         <nova:user uuid="e0e3f97050c448deba7ed9dbe0657c77">tempest-TestMinimumBasicScenario-1414513068-project-member</nova:user>
Apr 11 22:23:15 user nova-compute[71364]:         <nova:project uuid="8c29da1948d84b08acbb7893db590608">tempest-TestMinimumBasicScenario-1414513068</nova:project>
Apr 11 22:23:15 user nova-compute[71364]:       </nova:owner>
Apr 11 22:23:15 user nova-compute[71364]:       <nova:root type="image" uuid="5ebaba51-1209-4bc5-94bd-4d311bd19dd2"/>
Apr 11 22:23:15 user nova-compute[71364]:       <nova:ports>
Apr 11 22:23:15 user nova-compute[71364]:         <nova:port uuid="53fb131a-4441-4893-8296-1e9ba3a4eef5">
Apr 11 22:23:15 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 22:23:15 user nova-compute[71364]:         </nova:port>
Apr 11 22:23:15 user nova-compute[71364]:       </nova:ports>
Apr 11 22:23:15 user nova-compute[71364]:     </nova:instance>
Apr 11 22:23:15 user nova-compute[71364]:   </metadata>
Apr 11 22:23:15 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:23:15 user nova-compute[71364]:     <system>
Apr 11 22:23:15 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:23:15 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:23:15 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:23:15 user nova-compute[71364]:       <entry name="serial">a41689a7-1c45-45b8-8f75-c3f0a655cc18</entry>
Apr 11 22:23:15 user nova-compute[71364]:       <entry name="uuid">a41689a7-1c45-45b8-8f75-c3f0a655cc18</entry>
Apr 11 22:23:15 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:23:15 user nova-compute[71364]:     </system>
Apr 11 22:23:15 user nova-compute[71364]:   </sysinfo>
Apr 11 22:23:15 user nova-compute[71364]:   <os>
Apr 11 22:23:15 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:23:15 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:23:15 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:23:15 user nova-compute[71364]:   </os>
Apr 11 22:23:15 user nova-compute[71364]:   <features>
Apr 11 22:23:15 user nova-compute[71364]:     <acpi/>
Apr 11 22:23:15 user nova-compute[71364]:     <apic/>
Apr 11 22:23:15 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:23:15 user nova-compute[71364]:   </features>
Apr 11 22:23:15 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:23:15 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:23:15 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:23:15 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:23:15 user nova-compute[71364]:   </clock>
Apr 11 22:23:15 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:23:15 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:23:15 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:23:15 user nova-compute[71364]:   </cpu>
Apr 11 22:23:15 user nova-compute[71364]:   <devices>
Apr 11 22:23:15 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:23:15 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:23:15 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk"/>
Apr 11 22:23:15 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:23:15 user nova-compute[71364]:     </disk>
Apr 11 22:23:15 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:23:15 user nova-compute[71364]:       <mac address="fa:16:3e:54:fd:82"/>
Apr 11 22:23:15 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:23:15 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:23:15 user nova-compute[71364]:       <target dev="tap53fb131a-44"/>
Apr 11 22:23:15 user nova-compute[71364]:     </interface>
Apr 11 22:23:15 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:23:15 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/console.log" append="off"/>
Apr 11 22:23:15 user nova-compute[71364]:     </serial>
Apr 11 22:23:15 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:23:15 user nova-compute[71364]:     <video>
Apr 11 22:23:15 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:23:15 user nova-compute[71364]:     </video>
Apr 11 22:23:15 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:23:15 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:23:15 user nova-compute[71364]:     </rng>
Apr 11 22:23:15 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:23:15 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:23:15 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:23:15 user nova-compute[71364]:     </memballoon>
Apr 11 22:23:15 user nova-compute[71364]:   </devices>
Apr 11 22:23:15 user nova-compute[71364]: </domain>
Apr 11 22:23:15 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:23:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-886613326',display_name='tempest-TestMinimumBasicScenario-server-886613326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-886613326',id=44,image_ref='5ebaba51-1209-4bc5-94bd-4d311bd19dd2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLozpT3IVZpFExpqfZ7nWUmsdEQItZHyQVVZzd6wLHQO8XxFS1K2UtCfzqkj67b1mp4lxFDqCmYwQtfgNsNcOcp7JePHFi8MHbM5gfUCCTbQPZaZ7X9hbwKeBgtQjQMuJg==',key_name='tempest-TestMinimumBasicScenario-1734169471',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c29da1948d84b08acbb7893db590608',ramdisk_id='',reservation_id='r-cwqcq449',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ebaba51-1209-4bc5-94bd-4d311bd19dd2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1414513068',owner_user_name='tempest-TestMinimumBasicScenario-1414513068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:23:13Z,user_data=None,user_id='e0e3f97050c448deba7ed9dbe0657c77',uuid=a41689a7-1c45-45b8-8f75-c3f0a655cc18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converting VIF {"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:fd:82,bridge_name='br-int',has_traffic_filtering=True,id=53fb131a-4441-4893-8296-1e9ba3a4eef5,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fb131a-44') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG os_vif [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:fd:82,bridge_name='br-int',has_traffic_filtering=True,id=53fb131a-4441-4893-8296-1e9ba3a4eef5,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fb131a-44') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53fb131a-44, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap53fb131a-44, col_values=(('external_ids', {'iface-id': '53fb131a-4441-4893-8296-1e9ba3a4eef5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:fd:82', 'vm-uuid': 'a41689a7-1c45-45b8-8f75-c3f0a655cc18'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:15 user nova-compute[71364]: INFO os_vif [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:fd:82,bridge_name='br-int',has_traffic_filtering=True,id=53fb131a-4441-4893-8296-1e9ba3a4eef5,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fb131a-44')
Apr 11 22:23:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:23:15 user nova-compute[71364]: INFO nova.compute.claims [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Claim successful on node user
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] No VIF found with MAC fa:16:3e:54:fd:82, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.network.neutron [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:23:15 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.network.neutron [req-eaba093d-e126-4457-8446-e37f0902167c req-f092b718-1a73-458d-9104-165b1264ad73 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updated VIF entry in instance network info cache for port 53fb131a-4441-4893-8296-1e9ba3a4eef5. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.network.neutron [req-eaba093d-e126-4457-8446-e37f0902167c req-f092b718-1a73-458d-9104-165b1264ad73 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updating instance_info_cache with network_info: [{"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:23:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-eaba093d-e126-4457-8446-e37f0902167c req-f092b718-1a73-458d-9104-165b1264ad73 service nova] Releasing lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:23:16 user nova-compute[71364]: INFO nova.virt.block_device [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Booting with volume 175de249-59e7-4317-8527-f6e649a25950 at /dev/vda
Apr 11 22:23:16 user nova-compute[71364]: DEBUG nova.policy [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG os_brick.utils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb7a269-43b2-45ce-b541-84b2e4d817ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80b4a08-181e-4c04-9985-386da0995358]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca0c311-7d63-4948-a0d6-bc3b067e3bdd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1d75d4-6922-465a-8839-733622420d46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:23:16 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:23:16 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd293c8e-50b1-49a6-8c95-54a5324424b4]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG os_brick.utils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Updating existing volume attachment record: d5770790-4194-4ba6-9cdd-dceb8fe35ad4 {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG nova.network.neutron [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Successfully created port: eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-c304dd80-abe9-4f24-b902-116ad8cdb54f req-ab9d4c74-6fa4-4d68-af5c-764a031bb4eb service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c304dd80-abe9-4f24-b902-116ad8cdb54f req-ab9d4c74-6fa4-4d68-af5c-764a031bb4eb service nova] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c304dd80-abe9-4f24-b902-116ad8cdb54f req-ab9d4c74-6fa4-4d68-af5c-764a031bb4eb service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c304dd80-abe9-4f24-b902-116ad8cdb54f req-ab9d4c74-6fa4-4d68-af5c-764a031bb4eb service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-c304dd80-abe9-4f24-b902-116ad8cdb54f req-ab9d4c74-6fa4-4d68-af5c-764a031bb4eb service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] No waiting events found dispatching network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:23:17 user nova-compute[71364]: WARNING nova.compute.manager [req-c304dd80-abe9-4f24-b902-116ad8cdb54f req-ab9d4c74-6fa4-4d68-af5c-764a031bb4eb service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received unexpected event network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance with vm_state building and task_state spawning.
Apr 11 22:23:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG nova.network.neutron [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Successfully updated port: eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "refresh_cache-077c4c00-d46b-4d3f-8a17-22b2f0755149" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquired lock "refresh_cache-077c4c00-d46b-4d3f-8a17-22b2f0755149" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG nova.network.neutron [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-3b3987ef-28b4-4e79-b173-3a206314c5fb req-211f009a-eb95-4b9f-8b0b-b73bc6ff9c28 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Received event network-changed-eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG nova.compute.manager [req-3b3987ef-28b4-4e79-b173-3a206314c5fb req-211f009a-eb95-4b9f-8b0b-b73bc6ff9c28 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Refreshing instance network info cache due to event network-changed-eb906062-396a-4154-855a-179d801d0c75. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3b3987ef-28b4-4e79-b173-3a206314c5fb req-211f009a-eb95-4b9f-8b0b-b73bc6ff9c28 service nova] Acquiring lock "refresh_cache-077c4c00-d46b-4d3f-8a17-22b2f0755149" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:23:17 user nova-compute[71364]: DEBUG nova.network.neutron [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:23:18 user nova-compute[71364]: DEBUG nova.network.neutron [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Updating instance_info_cache with network_info: [{"id": "eb906062-396a-4154-855a-179d801d0c75", "address": "fa:16:3e:44:93:68", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb906062-39", "ovs_interfaceid": "eb906062-396a-4154-855a-179d801d0c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:23:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Releasing lock "refresh_cache-077c4c00-d46b-4d3f-8a17-22b2f0755149" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:23:18 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Instance network_info: |[{"id": "eb906062-396a-4154-855a-179d801d0c75", "address": "fa:16:3e:44:93:68", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb906062-39", "ovs_interfaceid": "eb906062-396a-4154-855a-179d801d0c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:23:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3b3987ef-28b4-4e79-b173-3a206314c5fb req-211f009a-eb95-4b9f-8b0b-b73bc6ff9c28 service nova] Acquired lock "refresh_cache-077c4c00-d46b-4d3f-8a17-22b2f0755149" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:23:18 user nova-compute[71364]: DEBUG nova.network.neutron [req-3b3987ef-28b4-4e79-b173-3a206314c5fb req-211f009a-eb95-4b9f-8b0b-b73bc6ff9c28 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Refreshing network info cache for port eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:23:18 user nova-compute[71364]: DEBUG nova.network.neutron [req-3b3987ef-28b4-4e79-b173-3a206314c5fb req-211f009a-eb95-4b9f-8b0b-b73bc6ff9c28 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Updated VIF entry in instance network info cache for port eb906062-396a-4154-855a-179d801d0c75. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:23:18 user nova-compute[71364]: DEBUG nova.network.neutron [req-3b3987ef-28b4-4e79-b173-3a206314c5fb req-211f009a-eb95-4b9f-8b0b-b73bc6ff9c28 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Updating instance_info_cache with network_info: [{"id": "eb906062-396a-4154-855a-179d801d0c75", "address": "fa:16:3e:44:93:68", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb906062-39", "ovs_interfaceid": "eb906062-396a-4154-855a-179d801d0c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:23:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3b3987ef-28b4-4e79-b173-3a206314c5fb req-211f009a-eb95-4b9f-8b0b-b73bc6ff9c28 service nova] Releasing lock "refresh_cache-077c4c00-d46b-4d3f-8a17-22b2f0755149" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.compute.manager [req-1c051d95-920a-42c2-92d7-de8703a87ffa req-7143258c-3ec3-4060-b703-f6af065189de service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1c051d95-920a-42c2-92d7-de8703a87ffa req-7143258c-3ec3-4060-b703-f6af065189de service nova] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1c051d95-920a-42c2-92d7-de8703a87ffa req-7143258c-3ec3-4060-b703-f6af065189de service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-1c051d95-920a-42c2-92d7-de8703a87ffa req-7143258c-3ec3-4060-b703-f6af065189de service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.compute.manager [req-1c051d95-920a-42c2-92d7-de8703a87ffa req-7143258c-3ec3-4060-b703-f6af065189de service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] No waiting events found dispatching network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:23:19 user nova-compute[71364]: WARNING nova.compute.manager [req-1c051d95-920a-42c2-92d7-de8703a87ffa req-7143258c-3ec3-4060-b703-f6af065189de service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received unexpected event network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance with vm_state building and task_state spawning.
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251799.2660294, a41689a7-1c45-45b8-8f75-c3f0a655cc18 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:23:19 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] VM Resumed (Lifecycle Event)
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:23:19 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Instance spawned successfully.
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:23:19 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251799.2678232, a41689a7-1c45-45b8-8f75-c3f0a655cc18 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:23:19 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] VM Started (Lifecycle Event)
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:23:19 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:23:19 user nova-compute[71364]: INFO nova.compute.manager [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Took 6.26 seconds to spawn the instance on the hypervisor.
Apr 11 22:23:19 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:23:19 user nova-compute[71364]: INFO nova.compute.manager [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Took 6.81 seconds to build instance.
Apr 11 22:23:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.905s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:23:20 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Creating image(s)
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Ensure instance console log exists: /opt/stack/data/nova/instances/077c4c00-d46b-4d3f-8a17-22b2f0755149/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Start _get_guest_xml network_info=[{"id": "eb906062-396a-4154-855a-179d801d0c75", "address": "fa:16:3e:44:93:68", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb906062-39", "ovs_interfaceid": "eb906062-396a-4154-855a-179d801d0c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkgGQAoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '077c4c00-d46b-4d3f-8a17-22b2f0755149', 'attached_at': '', 'detached_at': '', 'volume_id': '175de249-59e7-4317-8527-f6e649a25950', 'serial': '175de249-59e7-4317-8527-f6e649a25950'}, 'attachment_id': 'd5770790-4194-4ba6-9cdd-dceb8fe35ad4', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:23:20 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:23:20 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkgGQAoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:23:20 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:23:20 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:23:20 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e31a3e-4bc9-44c0-9aad-8a56a8835445]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:23:20 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cb4dd3-aef6-4aa6-9692-75e3edcfdfcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950] added
Apr 11 22:23:20 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4029e276-8f6f-4b26-8df7-483045f26d82]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfd6b4d-3acf-4585-94ad-46f4a6573135]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xkgGQAoT {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xkgGQAoT" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3204cab8-edc4-49d2-a4c9-654cf986ee18]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xkgGQAoT'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[346a4232-38dd-41b0-bf51-59a74475a204]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f65e65a-74d4-4edc-b286-91895087c26e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 22:23:20 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 22:23:20 user nova-compute[71364]:  {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:23:20 user nova-compute[71364]: WARNING os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 22:23:20 user nova-compute[71364]: 
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d394eb80-3047-405c-8630-a92e30eb0c1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260]
Apr 11 22:23:20 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260] successful.
Apr 11 22:23:20 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a2871a-0b09-4f4a-b2f2-8b305970f573]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[699ed5eb-3b6d-4863-99c4-cff135af9548]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:23:20 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:23:20 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[006873b7-67cc-4598-acfa-c8991370280a]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:23:20 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkgGQAoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:23:21 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23831383737363965', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831383737363965', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-523528427',display_name='tempest-TestVolumeBootPattern-server-523528427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-523528427',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhL8wvIVJR8pmHufcjS+qrhReOn1qW0FZHgyk9N8ASuVVlBrvCVhGiqfOJfs6P4gHo9Wb335OKfNzdYTniAwJX3G5QopUQic2JM2/NmnmU473vWMajYZtI3+7zQVS4dZA==',key_name='tempest-TestVolumeBootPattern-1915615362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-aqlpsih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:23:16Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=077c4c00-d46b-4d3f-8a17-22b2f0755149,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb906062-396a-4154-855a-179d801d0c75", "address": "fa:16:3e:44:93:68", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb906062-39", "ovs_interfaceid": "eb906062-396a-4154-855a-179d801d0c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "eb906062-396a-4154-855a-179d801d0c75", "address": "fa:16:3e:44:93:68", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb906062-39", "ovs_interfaceid": "eb906062-396a-4154-855a-179d801d0c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:93:68,bridge_name='br-int',has_traffic_filtering=True,id=eb906062-396a-4154-855a-179d801d0c75,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb906062-39') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.objects.instance [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lazy-loading 'pci_devices' on Instance uuid 077c4c00-d46b-4d3f-8a17-22b2f0755149 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Skipping network cache update for instance because it is Building. {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:23:22 user nova-compute[71364]:   <uuid>077c4c00-d46b-4d3f-8a17-22b2f0755149</uuid>
Apr 11 22:23:22 user nova-compute[71364]:   <name>instance-0000002d</name>
Apr 11 22:23:22 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:23:22 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:23:22 user nova-compute[71364]:   <metadata>
Apr 11 22:23:22 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:23:22 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:23:22 user nova-compute[71364]:       <nova:name>tempest-TestVolumeBootPattern-server-523528427</nova:name>
Apr 11 22:23:22 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:23:20</nova:creationTime>
Apr 11 22:23:22 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:23:22 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:23:22 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:23:22 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:23:22 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:23:22 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:23:22 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:23:22 user nova-compute[71364]:       <nova:owner>
Apr 11 22:23:22 user nova-compute[71364]:         <nova:user uuid="4fdb893b6ea3402788a89740355fa935">tempest-TestVolumeBootPattern-1208917682-project-member</nova:user>
Apr 11 22:23:22 user nova-compute[71364]:         <nova:project uuid="eb843e213c594ac28f864550ad68833b">tempest-TestVolumeBootPattern-1208917682</nova:project>
Apr 11 22:23:22 user nova-compute[71364]:       </nova:owner>
Apr 11 22:23:22 user nova-compute[71364]:       <nova:ports>
Apr 11 22:23:22 user nova-compute[71364]:         <nova:port uuid="eb906062-396a-4154-855a-179d801d0c75">
Apr 11 22:23:22 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 22:23:22 user nova-compute[71364]:         </nova:port>
Apr 11 22:23:22 user nova-compute[71364]:       </nova:ports>
Apr 11 22:23:22 user nova-compute[71364]:     </nova:instance>
Apr 11 22:23:22 user nova-compute[71364]:   </metadata>
Apr 11 22:23:22 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:23:22 user nova-compute[71364]:     <system>
Apr 11 22:23:22 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:23:22 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:23:22 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:23:22 user nova-compute[71364]:       <entry name="serial">077c4c00-d46b-4d3f-8a17-22b2f0755149</entry>
Apr 11 22:23:22 user nova-compute[71364]:       <entry name="uuid">077c4c00-d46b-4d3f-8a17-22b2f0755149</entry>
Apr 11 22:23:22 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:23:22 user nova-compute[71364]:     </system>
Apr 11 22:23:22 user nova-compute[71364]:   </sysinfo>
Apr 11 22:23:22 user nova-compute[71364]:   <os>
Apr 11 22:23:22 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:23:22 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:23:22 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:23:22 user nova-compute[71364]:   </os>
Apr 11 22:23:22 user nova-compute[71364]:   <features>
Apr 11 22:23:22 user nova-compute[71364]:     <acpi/>
Apr 11 22:23:22 user nova-compute[71364]:     <apic/>
Apr 11 22:23:22 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:23:22 user nova-compute[71364]:   </features>
Apr 11 22:23:22 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:23:22 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:23:22 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:23:22 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:23:22 user nova-compute[71364]:   </clock>
Apr 11 22:23:22 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:23:22 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:23:22 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:23:22 user nova-compute[71364]:   </cpu>
Apr 11 22:23:22 user nova-compute[71364]:   <devices>
Apr 11 22:23:22 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 22:23:22 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:23:22 user nova-compute[71364]:       <source dev="/dev/sdb"/>
Apr 11 22:23:22 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:23:22 user nova-compute[71364]:       <serial>175de249-59e7-4317-8527-f6e649a25950</serial>
Apr 11 22:23:22 user nova-compute[71364]:     </disk>
Apr 11 22:23:22 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:23:22 user nova-compute[71364]:       <mac address="fa:16:3e:44:93:68"/>
Apr 11 22:23:22 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:23:22 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:23:22 user nova-compute[71364]:       <target dev="tapeb906062-39"/>
Apr 11 22:23:22 user nova-compute[71364]:     </interface>
Apr 11 22:23:22 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:23:22 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/077c4c00-d46b-4d3f-8a17-22b2f0755149/console.log" append="off"/>
Apr 11 22:23:22 user nova-compute[71364]:     </serial>
Apr 11 22:23:22 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:23:22 user nova-compute[71364]:     <video>
Apr 11 22:23:22 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:23:22 user nova-compute[71364]:     </video>
Apr 11 22:23:22 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:23:22 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:23:22 user nova-compute[71364]:     </rng>
Apr 11 22:23:22 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:23:22 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:23:22 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:23:22 user nova-compute[71364]:     </memballoon>
Apr 11 22:23:22 user nova-compute[71364]:   </devices>
Apr 11 22:23:22 user nova-compute[71364]: </domain>
Apr 11 22:23:22 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-523528427',display_name='tempest-TestVolumeBootPattern-server-523528427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-523528427',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhL8wvIVJR8pmHufcjS+qrhReOn1qW0FZHgyk9N8ASuVVlBrvCVhGiqfOJfs6P4gHo9Wb335OKfNzdYTniAwJX3G5QopUQic2JM2/NmnmU473vWMajYZtI3+7zQVS4dZA==',key_name='tempest-TestVolumeBootPattern-1915615362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-aqlpsih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:23:16Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=077c4c00-d46b-4d3f-8a17-22b2f0755149,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb906062-396a-4154-855a-179d801d0c75", "address": "fa:16:3e:44:93:68", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb906062-39", "ovs_interfaceid": "eb906062-396a-4154-855a-179d801d0c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "eb906062-396a-4154-855a-179d801d0c75", "address": "fa:16:3e:44:93:68", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb906062-39", "ovs_interfaceid": "eb906062-396a-4154-855a-179d801d0c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:93:68,bridge_name='br-int',has_traffic_filtering=True,id=eb906062-396a-4154-855a-179d801d0c75,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb906062-39') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG os_vif [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:93:68,bridge_name='br-int',has_traffic_filtering=True,id=eb906062-396a-4154-855a-179d801d0c75,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb906062-39') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb906062-39, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb906062-39, col_values=(('external_ids', {'iface-id': 'eb906062-396a-4154-855a-179d801d0c75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:93:68', 'vm-uuid': '077c4c00-d46b-4d3f-8a17-22b2f0755149'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:22 user nova-compute[71364]: INFO os_vif [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:93:68,bridge_name='br-int',has_traffic_filtering=True,id=eb906062-396a-4154-855a-179d801d0c75,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb906062-39')
Apr 11 22:23:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.objects.instance [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lazy-loading 'info_cache' on Instance uuid a41689a7-1c45-45b8-8f75-c3f0a655cc18 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] No VIF found with MAC fa:16:3e:44:93:68, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updating instance_info_cache with network_info: [{"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:23:22 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:23:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-e12f9d87-ba5f-486d-8608-6118d2f5db08 req-8f863fff-086e-4c5b-b535-931dd54c3c24 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Received event network-vif-plugged-eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:23:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e12f9d87-ba5f-486d-8608-6118d2f5db08 req-8f863fff-086e-4c5b-b535-931dd54c3c24 service nova] Acquiring lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e12f9d87-ba5f-486d-8608-6118d2f5db08 req-8f863fff-086e-4c5b-b535-931dd54c3c24 service nova] Lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:23 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-e12f9d87-ba5f-486d-8608-6118d2f5db08 req-8f863fff-086e-4c5b-b535-931dd54c3c24 service nova] Lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:23 user nova-compute[71364]: DEBUG nova.compute.manager [req-e12f9d87-ba5f-486d-8608-6118d2f5db08 req-8f863fff-086e-4c5b-b535-931dd54c3c24 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] No waiting events found dispatching network-vif-plugged-eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:23:23 user nova-compute[71364]: WARNING nova.compute.manager [req-e12f9d87-ba5f-486d-8608-6118d2f5db08 req-8f863fff-086e-4c5b-b535-931dd54c3c24 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Received unexpected event network-vif-plugged-eb906062-396a-4154-855a-179d801d0c75 for instance with vm_state building and task_state spawning.
Apr 11 22:23:24 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:23:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:23:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251805.9325154, 077c4c00-d46b-4d3f-8a17-22b2f0755149 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:23:25 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] VM Resumed (Lifecycle Event)
Apr 11 22:23:25 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:23:25 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Instance spawned successfully.
Apr 11 22:23:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-bc1dc5ce-5518-4a68-8a30-0a81bdc53590 req-cc51646c-b739-470c-b997-91a3c83b9867 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Received event network-vif-plugged-eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bc1dc5ce-5518-4a68-8a30-0a81bdc53590 req-cc51646c-b739-470c-b997-91a3c83b9867 service nova] Acquiring lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bc1dc5ce-5518-4a68-8a30-0a81bdc53590 req-cc51646c-b739-470c-b997-91a3c83b9867 service nova] Lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-bc1dc5ce-5518-4a68-8a30-0a81bdc53590 req-cc51646c-b739-470c-b997-91a3c83b9867 service nova] Lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG nova.compute.manager [req-bc1dc5ce-5518-4a68-8a30-0a81bdc53590 req-cc51646c-b739-470c-b997-91a3c83b9867 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] No waiting events found dispatching network-vif-plugged-eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:23:25 user nova-compute[71364]: WARNING nova.compute.manager [req-bc1dc5ce-5518-4a68-8a30-0a81bdc53590 req-cc51646c-b739-470c-b997-91a3c83b9867 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Received unexpected event network-vif-plugged-eb906062-396a-4154-855a-179d801d0c75 for instance with vm_state building and task_state spawning.
Apr 11 22:23:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:23:25 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:23:26 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:23:26 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251805.9338207, 077c4c00-d46b-4d3f-8a17-22b2f0755149 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:23:26 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] VM Started (Lifecycle Event)
Apr 11 22:23:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:23:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:23:26 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:23:26 user nova-compute[71364]: INFO nova.compute.manager [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Took 5.45 seconds to spawn the instance on the hypervisor.
Apr 11 22:23:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:23:26 user nova-compute[71364]: INFO nova.compute.manager [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Took 10.60 seconds to build instance.
Apr 11 22:23:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "077c4c00-d46b-4d3f-8a17-22b2f0755149" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.721s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:32 user nova-compute[71364]: INFO nova.compute.manager [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Unshelving
Apr 11 22:23:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:32 user nova-compute[71364]: DEBUG nova.objects.instance [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'pci_requests' on Instance uuid 3879bb47-6592-4d9d-9e3c-fbbfc688335e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:23:32 user nova-compute[71364]: DEBUG nova.objects.instance [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'numa_topology' on Instance uuid 3879bb47-6592-4d9d-9e3c-fbbfc688335e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:23:32 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:23:32 user nova-compute[71364]: INFO nova.compute.claims [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Claim successful on node user
Apr 11 22:23:32 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:23:32 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:23:32 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:32 user nova-compute[71364]: INFO nova.network.neutron [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updating port b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquired lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG nova.network.neutron [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-555b4d1c-d55b-471d-aed4-183fc694fd12 req-a4ef319b-5def-47da-ac08-288e36bd9639 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received event network-changed-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG nova.compute.manager [req-555b4d1c-d55b-471d-aed4-183fc694fd12 req-a4ef319b-5def-47da-ac08-288e36bd9639 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Refreshing instance network info cache due to event network-changed-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-555b4d1c-d55b-471d-aed4-183fc694fd12 req-a4ef319b-5def-47da-ac08-288e36bd9639 service nova] Acquiring lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG nova.network.neutron [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updating instance_info_cache with network_info: [{"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Releasing lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:23:33 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Creating image(s)
Apr 11 22:23:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "/opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "/opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "/opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG nova.objects.instance [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3879bb47-6592-4d9d-9e3c-fbbfc688335e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-555b4d1c-d55b-471d-aed4-183fc694fd12 req-a4ef319b-5def-47da-ac08-288e36bd9639 service nova] Acquired lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG nova.network.neutron [req-555b4d1c-d55b-471d-aed4-183fc694fd12 req-a4ef319b-5def-47da-ac08-288e36bd9639 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Refreshing network info cache for port b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "9b3f2f0a0406c206ff35fd5dc5c10b9376a95045" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:33 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "9b3f2f0a0406c206ff35fd5dc5c10b9376a95045" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045.part --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045.part --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:34 user nova-compute[71364]: DEBUG nova.virt.images [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 1cf0d15b-af64-4121-8786-cca00f2f2293 was qcow2, converting to raw {{(pid=71364) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 11 22:23:34 user nova-compute[71364]: DEBUG nova.privsep.utils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71364) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 11 22:23:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045.part /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045.converted {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045.part /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045.converted" returned: 0 in 0.193s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045.converted --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:34 user nova-compute[71364]: DEBUG nova.network.neutron [req-555b4d1c-d55b-471d-aed4-183fc694fd12 req-a4ef319b-5def-47da-ac08-288e36bd9639 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updated VIF entry in instance network info cache for port b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:23:34 user nova-compute[71364]: DEBUG nova.network.neutron [req-555b4d1c-d55b-471d-aed4-183fc694fd12 req-a4ef319b-5def-47da-ac08-288e36bd9639 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updating instance_info_cache with network_info: [{"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:23:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-555b4d1c-d55b-471d-aed4-183fc694fd12 req-a4ef319b-5def-47da-ac08-288e36bd9639 service nova] Releasing lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:23:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:34 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "9b3f2f0a0406c206ff35fd5dc5c10b9376a95045" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.399s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:34 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045 --force-share --output=json" returned: 0 in 0.136s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "9b3f2f0a0406c206ff35fd5dc5c10b9376a95045" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "9b3f2f0a0406c206ff35fd5dc5c10b9376a95045" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045 --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045,backing_fmt=raw /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk 1073741824 {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045,backing_fmt=raw /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk 1073741824" returned: 0 in 0.047s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:35 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "9b3f2f0a0406c206ff35fd5dc5c10b9376a95045" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045 --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:35 user nova-compute[71364]: DEBUG nova.objects.instance [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'migration_context' on Instance uuid 3879bb47-6592-4d9d-9e3c-fbbfc688335e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:23:35 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Rebasing disk image.
Apr 11 22:23:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:35 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 -F raw /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 -F raw /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk" returned: 0 in 1.741s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Created local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Ensure instance console log exists: /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Start _get_guest_xml network_info=[{"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5f2d8331dcff3b2def6c6935ec6dad80',container_format='bare',created_at=2023-04-11T22:21:40Z,direct_url=<?>,disk_format='qcow2',id=1cf0d15b-af64-4121-8786-cca00f2f2293,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1104269846-shelved',owner='29e79d7c2e144af59f911973e79ba110',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T22:21:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'encryption_format': None, 'image_id': 'ca576860-9db2-47a8-a5c5-dc172050b182'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:23:37 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:23:37 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5f2d8331dcff3b2def6c6935ec6dad80',container_format='bare',created_at=2023-04-11T22:21:40Z,direct_url=<?>,disk_format='qcow2',id=1cf0d15b-af64-4121-8786-cca00f2f2293,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1104269846-shelved',owner='29e79d7c2e144af59f911973e79ba110',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-11T22:21:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.objects.instance [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3879bb47-6592-4d9d-9e3c-fbbfc688335e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T22:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1104269846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1104269846',id=43,image_ref='1cf0d15b-af64-4121-8786-cca00f2f2293',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-75772273',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:19:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='29e79d7c2e144af59f911973e79ba110',ramdisk_id='',reservation_id='r-49yyiiel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-590407943',owner_user_name='tempest-AttachVolumeShelveTestJSON-590407943-project-member',shelved_at='2023-04-11T22:21:43.098089',shelved_host='user',shelved_image_id='1cf0d15b-af64-4121-8786-cca00f2f2293'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5898621881a4e799df121e1d5957f42',uuid=3879bb47-6592-4d9d-9e3c-fbbfc688335e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converting VIF {"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4da2fe7-4f') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.objects.instance [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'pci_devices' on Instance uuid 3879bb47-6592-4d9d-9e3c-fbbfc688335e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:23:37 user nova-compute[71364]:   <uuid>3879bb47-6592-4d9d-9e3c-fbbfc688335e</uuid>
Apr 11 22:23:37 user nova-compute[71364]:   <name>instance-0000002b</name>
Apr 11 22:23:37 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:23:37 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:23:37 user nova-compute[71364]:   <metadata>
Apr 11 22:23:37 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:23:37 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:23:37 user nova-compute[71364]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1104269846</nova:name>
Apr 11 22:23:37 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:23:37</nova:creationTime>
Apr 11 22:23:37 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:23:37 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:23:37 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:23:37 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:23:37 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:23:37 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:23:37 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:23:37 user nova-compute[71364]:       <nova:owner>
Apr 11 22:23:37 user nova-compute[71364]:         <nova:user uuid="e5898621881a4e799df121e1d5957f42">tempest-AttachVolumeShelveTestJSON-590407943-project-member</nova:user>
Apr 11 22:23:37 user nova-compute[71364]:         <nova:project uuid="29e79d7c2e144af59f911973e79ba110">tempest-AttachVolumeShelveTestJSON-590407943</nova:project>
Apr 11 22:23:37 user nova-compute[71364]:       </nova:owner>
Apr 11 22:23:37 user nova-compute[71364]:       <nova:root type="image" uuid="1cf0d15b-af64-4121-8786-cca00f2f2293"/>
Apr 11 22:23:37 user nova-compute[71364]:       <nova:ports>
Apr 11 22:23:37 user nova-compute[71364]:         <nova:port uuid="b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a">
Apr 11 22:23:37 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 11 22:23:37 user nova-compute[71364]:         </nova:port>
Apr 11 22:23:37 user nova-compute[71364]:       </nova:ports>
Apr 11 22:23:37 user nova-compute[71364]:     </nova:instance>
Apr 11 22:23:37 user nova-compute[71364]:   </metadata>
Apr 11 22:23:37 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:23:37 user nova-compute[71364]:     <system>
Apr 11 22:23:37 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:23:37 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:23:37 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:23:37 user nova-compute[71364]:       <entry name="serial">3879bb47-6592-4d9d-9e3c-fbbfc688335e</entry>
Apr 11 22:23:37 user nova-compute[71364]:       <entry name="uuid">3879bb47-6592-4d9d-9e3c-fbbfc688335e</entry>
Apr 11 22:23:37 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:23:37 user nova-compute[71364]:     </system>
Apr 11 22:23:37 user nova-compute[71364]:   </sysinfo>
Apr 11 22:23:37 user nova-compute[71364]:   <os>
Apr 11 22:23:37 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:23:37 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:23:37 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:23:37 user nova-compute[71364]:   </os>
Apr 11 22:23:37 user nova-compute[71364]:   <features>
Apr 11 22:23:37 user nova-compute[71364]:     <acpi/>
Apr 11 22:23:37 user nova-compute[71364]:     <apic/>
Apr 11 22:23:37 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:23:37 user nova-compute[71364]:   </features>
Apr 11 22:23:37 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:23:37 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:23:37 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:23:37 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:23:37 user nova-compute[71364]:   </clock>
Apr 11 22:23:37 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:23:37 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:23:37 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:23:37 user nova-compute[71364]:   </cpu>
Apr 11 22:23:37 user nova-compute[71364]:   <devices>
Apr 11 22:23:37 user nova-compute[71364]:     <disk type="file" device="disk">
Apr 11 22:23:37 user nova-compute[71364]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 11 22:23:37 user nova-compute[71364]:       <source file="/opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk"/>
Apr 11 22:23:37 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:23:37 user nova-compute[71364]:     </disk>
Apr 11 22:23:37 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:23:37 user nova-compute[71364]:       <mac address="fa:16:3e:a6:d0:58"/>
Apr 11 22:23:37 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:23:37 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:23:37 user nova-compute[71364]:       <target dev="tapb4da2fe7-4f"/>
Apr 11 22:23:37 user nova-compute[71364]:     </interface>
Apr 11 22:23:37 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:23:37 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/console.log" append="off"/>
Apr 11 22:23:37 user nova-compute[71364]:     </serial>
Apr 11 22:23:37 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:23:37 user nova-compute[71364]:     <video>
Apr 11 22:23:37 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:23:37 user nova-compute[71364]:     </video>
Apr 11 22:23:37 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:23:37 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:23:37 user nova-compute[71364]:     </rng>
Apr 11 22:23:37 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:23:37 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:23:37 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:23:37 user nova-compute[71364]:     </memballoon>
Apr 11 22:23:37 user nova-compute[71364]:   </devices>
Apr 11 22:23:37 user nova-compute[71364]: </domain>
Apr 11 22:23:37 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T22:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1104269846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1104269846',id=43,image_ref='1cf0d15b-af64-4121-8786-cca00f2f2293',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-75772273',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:19:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='29e79d7c2e144af59f911973e79ba110',ramdisk_id='',reservation_id='r-49yyiiel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-590407943',owner_user_name='tempest-AttachVolumeShelveTestJSON-590407943-project-member',shelved_at='2023-04-11T22:21:43.098089',shelved_host='user',shelved_image_id='1cf0d15b-af64-4121-8786-cca00f2f2293'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5898621881a4e799df121e1d5957f42',uuid=3879bb47-6592-4d9d-9e3c-fbbfc688335e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converting VIF {"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4da2fe7-4f') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG os_vif [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4da2fe7-4f') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4da2fe7-4f, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4da2fe7-4f, col_values=(('external_ids', {'iface-id': 'b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:d0:58', 'vm-uuid': '3879bb47-6592-4d9d-9e3c-fbbfc688335e'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:37 user nova-compute[71364]: INFO os_vif [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4da2fe7-4f')
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:23:37 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] No VIF found with MAC fa:16:3e:a6:d0:58, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:23:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:39 user nova-compute[71364]: DEBUG nova.compute.manager [req-281e086b-d87a-4649-ba49-4206a95d513d req-0e10abb9-8966-4339-988b-05cf4fbf0e39 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received event network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:23:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-281e086b-d87a-4649-ba49-4206a95d513d req-0e10abb9-8966-4339-988b-05cf4fbf0e39 service nova] Acquiring lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-281e086b-d87a-4649-ba49-4206a95d513d req-0e10abb9-8966-4339-988b-05cf4fbf0e39 service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:39 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-281e086b-d87a-4649-ba49-4206a95d513d req-0e10abb9-8966-4339-988b-05cf4fbf0e39 service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:39 user nova-compute[71364]: DEBUG nova.compute.manager [req-281e086b-d87a-4649-ba49-4206a95d513d req-0e10abb9-8966-4339-988b-05cf4fbf0e39 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] No waiting events found dispatching network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:23:39 user nova-compute[71364]: WARNING nova.compute.manager [req-281e086b-d87a-4649-ba49-4206a95d513d req-0e10abb9-8966-4339-988b-05cf4fbf0e39 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received unexpected event network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 22:23:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:40 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251820.9716177, 3879bb47-6592-4d9d-9e3c-fbbfc688335e => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:23:40 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] VM Resumed (Lifecycle Event)
Apr 11 22:23:40 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:23:40 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:23:40 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Instance spawned successfully.
Apr 11 22:23:40 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:23:41 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:23:41 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:23:41 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251820.9727678, 3879bb47-6592-4d9d-9e3c-fbbfc688335e => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:23:41 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] VM Started (Lifecycle Event)
Apr 11 22:23:41 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:23:41 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:23:41 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:23:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-83b2b23e-b14f-4b69-aa31-29e1bf7f6d26 req-8394c466-6434-47e4-b049-3e7283bef3e6 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received event network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:23:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-83b2b23e-b14f-4b69-aa31-29e1bf7f6d26 req-8394c466-6434-47e4-b049-3e7283bef3e6 service nova] Acquiring lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:23:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-83b2b23e-b14f-4b69-aa31-29e1bf7f6d26 req-8394c466-6434-47e4-b049-3e7283bef3e6 service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:23:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-83b2b23e-b14f-4b69-aa31-29e1bf7f6d26 req-8394c466-6434-47e4-b049-3e7283bef3e6 service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-83b2b23e-b14f-4b69-aa31-29e1bf7f6d26 req-8394c466-6434-47e4-b049-3e7283bef3e6 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] No waiting events found dispatching network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:23:41 user nova-compute[71364]: WARNING nova.compute.manager [req-83b2b23e-b14f-4b69-aa31-29e1bf7f6d26 req-8394c466-6434-47e4-b049-3e7283bef3e6 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received unexpected event network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance with vm_state shelved_offloaded and task_state spawning.
Apr 11 22:23:41 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:23:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 9.271s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:23:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:23:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:23:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:23:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:23:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:23:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:24:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:24:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:24:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:24:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:13 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:24:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:24:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:24:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:24:13 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:24:13 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:24:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:24:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:24:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:24:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:24:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:24:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:24:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:24:13 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:24:14 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:24:14 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:24:14 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8541MB free_disk=26.049163818359375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:24:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:24:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:24:14 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:24:14 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:24:14 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:24:14 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:24:14 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:24:14 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:24:14 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:24:14 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:24:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:24:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:24:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:24:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:24:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:24:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:17 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:24:22 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:24:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:24:23 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:24:23 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:24:23 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:24:24 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:24:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:24:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 22:24:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:24:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:24:24 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:24:24 user nova-compute[71364]: DEBUG nova.objects.instance [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lazy-loading 'info_cache' on Instance uuid 3879bb47-6592-4d9d-9e3c-fbbfc688335e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:24:24 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updating instance_info_cache with network_info: [{"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:24:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-3879bb47-6592-4d9d-9e3c-fbbfc688335e" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:24:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:24:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:26 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:24:26 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:24:26 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:24:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:24:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:24:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:24:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:24:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:24:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:24:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:24:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:25:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:25:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:25:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:25:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG nova.objects.instance [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'flavor' on Instance uuid a41689a7-1c45-45b8-8f75-c3f0a655cc18 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:04 user nova-compute[71364]: INFO nova.compute.manager [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Attaching volume 0ab5b289-3649-444b-92ea-2a5d0fd10e21 to /dev/vdb
Apr 11 22:25:04 user nova-compute[71364]: DEBUG os_brick.utils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8349e3-e2eb-48da-8ef6-02d63fe23879]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b220e1c4-9c13-4de9-b5b6-13075e8fb4d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ca1050-a988-4ca0-a450-9d070be15760]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a4ebeb-b393-4377-b4ac-ff55c49a2c98]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:25:04 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:25:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dfaaff-c866-4e84-9b5a-0346bc33541f]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG os_brick.utils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:25:04 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updating existing volume attachment record: 72cb15d7-29ad-49ef-a942-3dfc098f377a {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:25:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-79f724fe-73d3-4fdf-ba5c-5e9eaf24d80e req-81489559-874b-44db-ae1c-477a0e84de26 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Received event network-changed-eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-79f724fe-73d3-4fdf-ba5c-5e9eaf24d80e req-81489559-874b-44db-ae1c-477a0e84de26 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Refreshing instance network info cache due to event network-changed-eb906062-396a-4154-855a-179d801d0c75. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-79f724fe-73d3-4fdf-ba5c-5e9eaf24d80e req-81489559-874b-44db-ae1c-477a0e84de26 service nova] Acquiring lock "refresh_cache-077c4c00-d46b-4d3f-8a17-22b2f0755149" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-79f724fe-73d3-4fdf-ba5c-5e9eaf24d80e req-81489559-874b-44db-ae1c-477a0e84de26 service nova] Acquired lock "refresh_cache-077c4c00-d46b-4d3f-8a17-22b2f0755149" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG nova.network.neutron [req-79f724fe-73d3-4fdf-ba5c-5e9eaf24d80e req-81489559-874b-44db-ae1c-477a0e84de26 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Refreshing network info cache for port eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "077c4c00-d46b-4d3f-8a17-22b2f0755149" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "077c4c00-d46b-4d3f-8a17-22b2f0755149" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:07 user nova-compute[71364]: INFO nova.compute.manager [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Terminating instance
Apr 11 22:25:07 user nova-compute[71364]: DEBUG nova.compute.manager [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG nova.network.neutron [req-79f724fe-73d3-4fdf-ba5c-5e9eaf24d80e req-81489559-874b-44db-ae1c-477a0e84de26 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Updated VIF entry in instance network info cache for port eb906062-396a-4154-855a-179d801d0c75. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG nova.network.neutron [req-79f724fe-73d3-4fdf-ba5c-5e9eaf24d80e req-81489559-874b-44db-ae1c-477a0e84de26 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Updating instance_info_cache with network_info: [{"id": "eb906062-396a-4154-855a-179d801d0c75", "address": "fa:16:3e:44:93:68", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb906062-39", "ovs_interfaceid": "eb906062-396a-4154-855a-179d801d0c75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:25:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-79f724fe-73d3-4fdf-ba5c-5e9eaf24d80e req-81489559-874b-44db-ae1c-477a0e84de26 service nova] Releasing lock "refresh_cache-077c4c00-d46b-4d3f-8a17-22b2f0755149" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:25:08 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Instance destroyed successfully.
Apr 11 22:25:08 user nova-compute[71364]: DEBUG nova.objects.instance [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lazy-loading 'resources' on Instance uuid 077c4c00-d46b-4d3f-8a17-22b2f0755149 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-523528427',display_name='tempest-TestVolumeBootPattern-server-523528427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-523528427',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhL8wvIVJR8pmHufcjS+qrhReOn1qW0FZHgyk9N8ASuVVlBrvCVhGiqfOJfs6P4gHo9Wb335OKfNzdYTniAwJX3G5QopUQic2JM2/NmnmU473vWMajYZtI3+7zQVS4dZA==',key_name='tempest-TestVolumeBootPattern-1915615362',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:23:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-aqlpsih1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:23:26Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=077c4c00-d46b-4d3f-8a17-22b2f0755149,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb906062-396a-4154-855a-179d801d0c75", "address": "fa:16:3e:44:93:68", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb906062-39", "ovs_interfaceid": "eb906062-396a-4154-855a-179d801d0c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "eb906062-396a-4154-855a-179d801d0c75", "address": "fa:16:3e:44:93:68", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb906062-39", "ovs_interfaceid": "eb906062-396a-4154-855a-179d801d0c75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:93:68,bridge_name='br-int',has_traffic_filtering=True,id=eb906062-396a-4154-855a-179d801d0c75,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb906062-39') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_vif [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:93:68,bridge_name='br-int',has_traffic_filtering=True,id=eb906062-396a-4154-855a-179d801d0c75,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb906062-39') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb906062-39, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:08 user nova-compute[71364]: INFO os_vif [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:93:68,bridge_name='br-int',has_traffic_filtering=True,id=eb906062-396a-4154-855a-179d801d0c75,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb906062-39')
Apr 11 22:25:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkgGQAoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:25:08 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e201bae-1b63-4879-8c7b-a388ae6fd5f9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:25:08 user nova-compute[71364]: No targets found.
Apr 11 22:25:08 user nova-compute[71364]: iSNS:
Apr 11 22:25:08 user nova-compute[71364]: No targets found.
Apr 11 22:25:08 user nova-compute[71364]: STATIC:
Apr 11 22:25:08 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950
Apr 11 22:25:08 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:25:08 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:25:08 user nova-compute[71364]: FIRMWARE:
Apr 11 22:25:08 user nova-compute[71364]: No targets found.
Apr 11 22:25:08 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:25:08 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:25:08 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ea8d3f-173c-4f92-b9b1-8dcdc9a35e8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7197181-0218-4525-8f13-9d32fd7def2d]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:25:08 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:25:08 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bf02bf250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef31392-6ad7-424c-a7cf-fbba8e7aeed9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce27a836-f703-4e5e-b16f-385d9c61ac65]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56535ae-2529-4ac5-9b37-30bcf759ab2a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fb71c1-ac87-46b6-b7bc-10219b384bbd]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23831383737363965', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f2924e5c', '/dev/disk/by-id/scsi-1SCST_BIOf2924e5c-8187769e58698bee') {{(pid=81576) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d811273a-710d-4aa7-9597-e9c073e827d9]: (4, None) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ecbfcc-1d09-4935-8a7c-ad034bd86800]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ee01ed-5fd1-438f-9dc2-c54f333bf0c0]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260]
Apr 11 22:25:08 user nova-compute[71364]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260] successful.
Apr 11 22:25:08 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d31d3e-911d-4af2-9f53-f20d1ada27c4]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== disconnect_volume: return (289ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:25:08 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Deleting instance files /opt/stack/data/nova/instances/077c4c00-d46b-4d3f-8a17-22b2f0755149_del
Apr 11 22:25:08 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Deletion of /opt/stack/data/nova/instances/077c4c00-d46b-4d3f-8a17-22b2f0755149_del complete
Apr 11 22:25:08 user nova-compute[71364]: INFO nova.compute.manager [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 11 22:25:08 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:25:08 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PivwDNnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:25:09 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:25:09 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:25:09 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[667bf0fd-9003-4d0c-92e1-6ac634ccd6a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:25:09 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53ba0f5-2ef5-49c3-a0c3-9be6b896f400]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21] added
Apr 11 22:25:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59cc526-590e-4dad-9942-35ab6d6087b8]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ed5098-cdae-4751-a3fa-a35998835723]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PivwDNnV {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PivwDNnV" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a30ae4-3bdd-4dec-a17b-8cdb1112981d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PivwDNnV'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b0f10e-9db5-46d4-9630-9adee53540e7]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e0df6f-d910-4136-b028-615bc26b07e3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 11 22:25:09 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 11 22:25:09 user nova-compute[71364]:  {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:25:09 user nova-compute[71364]: WARNING os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 11 22:25:09 user nova-compute[71364]: 
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[27620d6e-42fa-466b-b312-d33eece3cd8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21, portal: 172.16.0.220,3260]
Apr 11 22:25:09 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21, portal: 172.16.0.220,3260] successful.
Apr 11 22:25:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[69797f1c-c947-443b-a52e-5505189e557a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Received event network-vif-unplugged-eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] Acquiring lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] Lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] Lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] No waiting events found dispatching network-vif-unplugged-eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Received event network-vif-unplugged-eb906062-396a-4154-855a-179d801d0c75 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Received event network-vif-plugged-eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] Acquiring lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] Lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] Lock "077c4c00-d46b-4d3f-8a17-22b2f0755149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] No waiting events found dispatching network-vif-plugged-eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:25:09 user nova-compute[71364]: WARNING nova.compute.manager [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Received unexpected event network-vif-plugged-eb906062-396a-4154-855a-179d801d0c75 for instance with vm_state active and task_state deleting.
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9e48ca-bf77-4a27-9d57-255e39777461]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 (non-flash)
Apr 11 22:25:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 (non-flash)
Apr 11 22:25:09 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bda825-9b21-415e-acdf-70add334c07c]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PivwDNnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:25:09 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:25:09 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Took 0.81 seconds to deallocate network for instance.
Apr 11 22:25:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:10 user nova-compute[71364]: INFO nova.compute.manager [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Took 0.75 seconds to detach 1 volumes for instance.
Apr 11 22:25:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:25:10 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23736626135313432', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:25:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736626135313432', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:25:10 user nova-compute[71364]: DEBUG nova.objects.instance [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'flavor' on Instance uuid a41689a7-1c45-45b8-8f75-c3f0a655cc18 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:25:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] attach device xml: <disk type="block" device="disk">
Apr 11 22:25:10 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:25:10 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:25:10 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:25:10 user nova-compute[71364]:   <serial>0ab5b289-3649-444b-92ea-2a5d0fd10e21</serial>
Apr 11 22:25:10 user nova-compute[71364]: </disk>
Apr 11 22:25:10 user nova-compute[71364]:  {{(pid=71364) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 11 22:25:10 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:25:10 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:25:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:10 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Deleted allocations for instance 077c4c00-d46b-4d3f-8a17-22b2f0755149
Apr 11 22:25:10 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "077c4c00-d46b-4d3f-8a17-22b2f0755149" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.149s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:25:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:25:10 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] No VIF found with MAC fa:16:3e:54:fd:82, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:25:11 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.200s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:11 user nova-compute[71364]: DEBUG nova.compute.manager [req-3f2a1586-787a-42b5-b516-40b79b27d8e0 req-ef815765-6932-4766-87c6-b9b2d82406d1 service nova] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Received event network-vif-deleted-eb906062-396a-4154-855a-179d801d0c75 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:25:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-95a6e9e6-786f-4058-8a75-a494f95d6e1a req-42886ae9-e563-4d71-9a2a-503cbb7503e7 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-changed-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:25:13 user nova-compute[71364]: DEBUG nova.compute.manager [req-95a6e9e6-786f-4058-8a75-a494f95d6e1a req-42886ae9-e563-4d71-9a2a-503cbb7503e7 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Refreshing instance network info cache due to event network-changed-53fb131a-4441-4893-8296-1e9ba3a4eef5. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:25:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-95a6e9e6-786f-4058-8a75-a494f95d6e1a req-42886ae9-e563-4d71-9a2a-503cbb7503e7 service nova] Acquiring lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:25:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-95a6e9e6-786f-4058-8a75-a494f95d6e1a req-42886ae9-e563-4d71-9a2a-503cbb7503e7 service nova] Acquired lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:25:13 user nova-compute[71364]: DEBUG nova.network.neutron [req-95a6e9e6-786f-4058-8a75-a494f95d6e1a req-42886ae9-e563-4d71-9a2a-503cbb7503e7 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Refreshing network info cache for port 53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:25:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:13 user nova-compute[71364]: DEBUG nova.network.neutron [req-95a6e9e6-786f-4058-8a75-a494f95d6e1a req-42886ae9-e563-4d71-9a2a-503cbb7503e7 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updated VIF entry in instance network info cache for port 53fb131a-4441-4893-8296-1e9ba3a4eef5. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:25:13 user nova-compute[71364]: DEBUG nova.network.neutron [req-95a6e9e6-786f-4058-8a75-a494f95d6e1a req-42886ae9-e563-4d71-9a2a-503cbb7503e7 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updating instance_info_cache with network_info: [{"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:25:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-95a6e9e6-786f-4058-8a75-a494f95d6e1a req-42886ae9-e563-4d71-9a2a-503cbb7503e7 service nova] Releasing lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:25:14 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:25:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:14 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:14 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:25:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:14 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:14 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-f449db41-46d9-4286-a3d3-57a0d5bae558 req-78bc4057-55e6-415a-8d4d-cbdbe5beede3 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-changed-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG nova.compute.manager [req-f449db41-46d9-4286-a3d3-57a0d5bae558 req-78bc4057-55e6-415a-8d4d-cbdbe5beede3 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Refreshing instance network info cache due to event network-changed-53fb131a-4441-4893-8296-1e9ba3a4eef5. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f449db41-46d9-4286-a3d3-57a0d5bae558 req-78bc4057-55e6-415a-8d4d-cbdbe5beede3 service nova] Acquiring lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f449db41-46d9-4286-a3d3-57a0d5bae558 req-78bc4057-55e6-415a-8d4d-cbdbe5beede3 service nova] Acquired lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG nova.network.neutron [req-f449db41-46d9-4286-a3d3-57a0d5bae558 req-78bc4057-55e6-415a-8d4d-cbdbe5beede3 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Refreshing network info cache for port 53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:25:15 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:25:15 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:25:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8576MB free_disk=26.047809600830078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:15 user nova-compute[71364]: INFO nova.compute.manager [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Rebooting instance
Apr 11 22:25:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG nova.network.neutron [req-f449db41-46d9-4286-a3d3-57a0d5bae558 req-78bc4057-55e6-415a-8d4d-cbdbe5beede3 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updated VIF entry in instance network info cache for port 53fb131a-4441-4893-8296-1e9ba3a4eef5. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG nova.network.neutron [req-f449db41-46d9-4286-a3d3-57a0d5bae558 req-78bc4057-55e6-415a-8d4d-cbdbe5beede3 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updating instance_info_cache with network_info: [{"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f449db41-46d9-4286-a3d3-57a0d5bae558 req-78bc4057-55e6-415a-8d4d-cbdbe5beede3 service nova] Releasing lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquired lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:25:15 user nova-compute[71364]: DEBUG nova.network.neutron [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:25:16 user nova-compute[71364]: DEBUG nova.network.neutron [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updating instance_info_cache with network_info: [{"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:25:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Releasing lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:25:16 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:25:17 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:25:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-3148b170-ead2-442b-be22-1fa690fcf6d7 req-c036ba33-ae40-49f5-a1d2-e67d69474152 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-vif-unplugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:25:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3148b170-ead2-442b-be22-1fa690fcf6d7 req-c036ba33-ae40-49f5-a1d2-e67d69474152 service nova] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3148b170-ead2-442b-be22-1fa690fcf6d7 req-c036ba33-ae40-49f5-a1d2-e67d69474152 service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-3148b170-ead2-442b-be22-1fa690fcf6d7 req-c036ba33-ae40-49f5-a1d2-e67d69474152 service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:18 user nova-compute[71364]: DEBUG nova.compute.manager [req-3148b170-ead2-442b-be22-1fa690fcf6d7 req-c036ba33-ae40-49f5-a1d2-e67d69474152 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] No waiting events found dispatching network-vif-unplugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:25:18 user nova-compute[71364]: WARNING nova.compute.manager [req-3148b170-ead2-442b-be22-1fa690fcf6d7 req-c036ba33-ae40-49f5-a1d2-e67d69474152 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received unexpected event network-vif-unplugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance with vm_state active and task_state reboot_started.
Apr 11 22:25:19 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Instance shutdown successfully.
Apr 11 22:25:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:20 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-b5a53384-6ace-46c4-9fdd-c2e45bc48aef req-a9afd827-182c-49bd-974a-3fed2a621a43 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:25:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b5a53384-6ace-46c4-9fdd-c2e45bc48aef req-a9afd827-182c-49bd-974a-3fed2a621a43 service nova] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b5a53384-6ace-46c4-9fdd-c2e45bc48aef req-a9afd827-182c-49bd-974a-3fed2a621a43 service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:20 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b5a53384-6ace-46c4-9fdd-c2e45bc48aef req-a9afd827-182c-49bd-974a-3fed2a621a43 service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:20 user nova-compute[71364]: DEBUG nova.compute.manager [req-b5a53384-6ace-46c4-9fdd-c2e45bc48aef req-a9afd827-182c-49bd-974a-3fed2a621a43 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] No waiting events found dispatching network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:25:20 user nova-compute[71364]: WARNING nova.compute.manager [req-b5a53384-6ace-46c4-9fdd-c2e45bc48aef req-a9afd827-182c-49bd-974a-3fed2a621a43 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received unexpected event network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance with vm_state active and task_state reboot_started.
Apr 11 22:25:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:22 user nova-compute[71364]: INFO nova.compute.manager [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Terminating instance
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:22 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Instance destroyed successfully.
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.objects.instance [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'resources' on Instance uuid 3879bb47-6592-4d9d-9e3c-fbbfc688335e {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] No waiting events found dispatching network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:25:22 user nova-compute[71364]: WARNING nova.compute.manager [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received unexpected event network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance with vm_state active and task_state reboot_started.
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] No waiting events found dispatching network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:25:22 user nova-compute[71364]: WARNING nova.compute.manager [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received unexpected event network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance with vm_state active and task_state reboot_started.
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received event network-vif-unplugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Acquiring lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] No waiting events found dispatching network-vif-unplugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received event network-vif-unplugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received event network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Acquiring lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] No waiting events found dispatching network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:25:22 user nova-compute[71364]: WARNING nova.compute.manager [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received unexpected event network-vif-plugged-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance with vm_state active and task_state deleting.
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-11T22:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1104269846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1104269846',id=43,image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9ha7w4Yx2Ct4yNyWAG+y2X1fGRwyualBpBeukX0mkbXyGthnVwMyhQhZxUhJmIzxFqpZJ/5uqBRNCMtZuCVp7UVwu5uwMc/x/kd2EHdYmC74j0KpKixiMzFdJ8OyMPZg==',key_name='tempest-keypair-75772273',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:23:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29e79d7c2e144af59f911973e79ba110',ramdisk_id='',reservation_id='r-49yyiiel',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='ca576860-9db2-47a8-a5c5-dc172050b182',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-590407943',owner_user_name='tempest-AttachVolumeShelveTestJSON-590407943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:23:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e5898621881a4e799df121e1d5957f42',uuid=3879bb47-6592-4d9d-9e3c-fbbfc688335e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converting VIF {"id": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "address": "fa:16:3e:a6:d0:58", "network": {"id": "0f941311-b91c-4637-9cf6-2a218b8e4426", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1771935598-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29e79d7c2e144af59f911973e79ba110", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4da2fe7-4f", "ovs_interfaceid": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4da2fe7-4f') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG os_vif [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4da2fe7-4f') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4da2fe7-4f, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:25:22 user nova-compute[71364]: INFO os_vif [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:d0:58,bridge_name='br-int',has_traffic_filtering=True,id=b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a,network=Network(0f941311-b91c-4637-9cf6-2a218b8e4426),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4da2fe7-4f')
Apr 11 22:25:22 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Deleting instance files /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e_del
Apr 11 22:25:22 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Deletion of /opt/stack/data/nova/instances/3879bb47-6592-4d9d-9e3c-fbbfc688335e_del complete
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.virt.libvirt.host [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Removed pending event for a41689a7-1c45-45b8-8f75-c3f0a655cc18 due to event {{(pid=71364) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251922.7038312, a41689a7-1c45-45b8-8f75-c3f0a655cc18 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:25:22 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] VM Resumed (Lifecycle Event)
Apr 11 22:25:22 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Instance running successfully.
Apr 11 22:25:22 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Instance soft rebooted successfully.
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:25:22 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251922.7040584, a41689a7-1c45-45b8-8f75-c3f0a655cc18 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:25:22 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] VM Started (Lifecycle Event)
Apr 11 22:25:22 user nova-compute[71364]: INFO nova.compute.manager [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.529s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:25:22 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:25:23 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:25:23 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251908.3843355, 077c4c00-d46b-4d3f-8a17-22b2f0755149 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:25:23 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] VM Stopped (Lifecycle Event)
Apr 11 22:25:23 user nova-compute[71364]: DEBUG nova.compute.manager [None req-025124e6-b6ff-4445-aa79-acc76b4204bc None None] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:25:24 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Took 1.31 seconds to deallocate network for instance.
Apr 11 22:25:24 user nova-compute[71364]: DEBUG nova.compute.manager [req-3b022c8e-8d8d-45ab-8b1d-be8d2f98447c req-68dd13d9-6bbd-47da-84dc-ec26f6a3e786 service nova] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Received event network-vif-deleted-b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:24 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Deleted allocations for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e
Apr 11 22:25:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "3879bb47-6592-4d9d-9e3c-fbbfc688335e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.385s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updating instance_info_cache with network_info: [{"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:25:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:25 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:25:26 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:25:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:25:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:28 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:25:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:37 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681251922.6511698, 3879bb47-6592-4d9d-9e3c-fbbfc688335e => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:25:37 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] VM Stopped (Lifecycle Event)
Apr 11 22:25:37 user nova-compute[71364]: DEBUG nova.compute.manager [None req-dbd77519-4a38-4ecd-b145-a174763117d3 None None] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:25:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:25:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:25:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:25:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:25:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Verify base images {{(pid=71364) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Image id 5ebaba51-1209-4bc5-94bd-4d311bd19dd2 yields fingerprint e7cc7f8e794c6f2ce6f87044e7d9f857d646031e {{(pid=71364) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 11 22:25:43 user nova-compute[71364]: INFO nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] image 5ebaba51-1209-4bc5-94bd-4d311bd19dd2 at (/opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e): checking
Apr 11 22:25:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] image 5ebaba51-1209-4bc5-94bd-4d311bd19dd2 at (/opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e): image is in use {{(pid=71364) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71364) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] a41689a7-1c45-45b8-8f75-c3f0a655cc18 is a valid instance name {{(pid=71364) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] a41689a7-1c45-45b8-8f75-c3f0a655cc18 has a disk file {{(pid=71364) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 is backed by e7cc7f8e794c6f2ce6f87044e7d9f857d646031e {{(pid=71364) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 11 22:25:43 user nova-compute[71364]: WARNING nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Unknown base file: /opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98
Apr 11 22:25:43 user nova-compute[71364]: WARNING nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483
Apr 11 22:25:43 user nova-compute[71364]: WARNING nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045
Apr 11 22:25:43 user nova-compute[71364]: WARNING nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Unknown base file: /opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e
Apr 11 22:25:43 user nova-compute[71364]: WARNING nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793
Apr 11 22:25:43 user nova-compute[71364]: WARNING nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c
Apr 11 22:25:43 user nova-compute[71364]: WARNING nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Unknown base file: /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413
Apr 11 22:25:43 user nova-compute[71364]: WARNING nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59
Apr 11 22:25:43 user nova-compute[71364]: WARNING nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Unknown base file: /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271
Apr 11 22:25:43 user nova-compute[71364]: INFO nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Active base files: /opt/stack/data/nova/instances/_base/e7cc7f8e794c6f2ce6f87044e7d9f857d646031e
Apr 11 22:25:43 user nova-compute[71364]: INFO nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Removable base files: /opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98 /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483 /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045 /opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793 /opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413 /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59 /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271
Apr 11 22:25:43 user nova-compute[71364]: INFO nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/15b56df91235533f7960d332bd2405eef1867f98
Apr 11 22:25:43 user nova-compute[71364]: INFO nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3bbd032191ffa26007665e7631c27b84b72bc483
Apr 11 22:25:43 user nova-compute[71364]: INFO nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9b3f2f0a0406c206ff35fd5dc5c10b9376a95045
Apr 11 22:25:43 user nova-compute[71364]: INFO nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/476bc793ad533d349fee4a742a2f862e218ed29e
Apr 11 22:25:43 user nova-compute[71364]: INFO nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d333d8b0d306aabd40f87b470a0113e9a8049793
Apr 11 22:25:43 user nova-compute[71364]: INFO nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1f36cc6e1b1d327397d32b02a1e67716e622652c
Apr 11 22:25:43 user nova-compute[71364]: INFO nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/663141c000b0a5747d1e47b16df0e584bb67d413
Apr 11 22:25:43 user nova-compute[71364]: INFO nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a144ea60a6de8246c688997a205bb18c14c2be59
Apr 11 22:25:43 user nova-compute[71364]: INFO nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/63fd026d7991e8cc7dab3f4a49c81d753eddf271
Apr 11 22:25:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Verification complete {{(pid=71364) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Verify swap images {{(pid=71364) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 11 22:25:43 user nova-compute[71364]: DEBUG nova.virt.libvirt.imagecache [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Verify ephemeral images {{(pid=71364) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 11 22:25:44 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:25:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:25:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:59 user nova-compute[71364]: DEBUG nova.compute.manager [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:25:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:25:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:25:59 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:25:59 user nova-compute[71364]: INFO nova.compute.claims [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Claim successful on node user
Apr 11 22:26:00 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:26:00 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:26:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:26:00 user nova-compute[71364]: INFO nova.virt.block_device [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Booting with volume 175de249-59e7-4317-8527-f6e649a25950 at /dev/vda
Apr 11 22:26:00 user nova-compute[71364]: DEBUG nova.policy [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG os_brick.utils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cb8a41-0ad8-406f-9451-b4654fae605c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[82716649-f55d-47ea-a2b1-8c35bad0e1af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf07afea-bac2-4562-b27f-5dfe90510995]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dbdaca-8044-40b0-806b-bb1d1ed5b0ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:26:00 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:26:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[35243fb2-a70a-41f6-82e1-40cf0c8c1528]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG os_brick.utils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Updating existing volume attachment record: e6fd5f99-2f3e-419e-886c-fe0af2b9712c {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:26:00 user nova-compute[71364]: DEBUG nova.network.neutron [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Successfully created port: 84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:26:01 user nova-compute[71364]: DEBUG nova.network.neutron [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Successfully updated port: 84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:26:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:26:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquired lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:26:01 user nova-compute[71364]: DEBUG nova.network.neutron [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:26:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-fed3dc73-ff47-4b71-bc7c-b74fd0877137 req-22708539-6d92-45e3-b8bb-eed15ff7251f service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Received event network-changed-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:26:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-fed3dc73-ff47-4b71-bc7c-b74fd0877137 req-22708539-6d92-45e3-b8bb-eed15ff7251f service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Refreshing instance network info cache due to event network-changed-84e9c2ec-b042-4069-a1b6-7fb51fc690b8. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:26:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fed3dc73-ff47-4b71-bc7c-b74fd0877137 req-22708539-6d92-45e3-b8bb-eed15ff7251f service nova] Acquiring lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:26:01 user nova-compute[71364]: DEBUG nova.network.neutron [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:26:01 user nova-compute[71364]: DEBUG nova.network.neutron [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Updating instance_info_cache with network_info: [{"id": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "address": "fa:16:3e:5d:e3:e6", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e9c2ec-b0", "ovs_interfaceid": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:26:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Releasing lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:26:01 user nova-compute[71364]: DEBUG nova.compute.manager [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Instance network_info: |[{"id": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "address": "fa:16:3e:5d:e3:e6", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e9c2ec-b0", "ovs_interfaceid": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:26:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fed3dc73-ff47-4b71-bc7c-b74fd0877137 req-22708539-6d92-45e3-b8bb-eed15ff7251f service nova] Acquired lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:26:01 user nova-compute[71364]: DEBUG nova.network.neutron [req-fed3dc73-ff47-4b71-bc7c-b74fd0877137 req-22708539-6d92-45e3-b8bb-eed15ff7251f service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Refreshing network info cache for port 84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:26:02 user nova-compute[71364]: DEBUG nova.network.neutron [req-fed3dc73-ff47-4b71-bc7c-b74fd0877137 req-22708539-6d92-45e3-b8bb-eed15ff7251f service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Updated VIF entry in instance network info cache for port 84e9c2ec-b042-4069-a1b6-7fb51fc690b8. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:26:02 user nova-compute[71364]: DEBUG nova.network.neutron [req-fed3dc73-ff47-4b71-bc7c-b74fd0877137 req-22708539-6d92-45e3-b8bb-eed15ff7251f service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Updating instance_info_cache with network_info: [{"id": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "address": "fa:16:3e:5d:e3:e6", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e9c2ec-b0", "ovs_interfaceid": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:26:02 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-fed3dc73-ff47-4b71-bc7c-b74fd0877137 req-22708539-6d92-45e3-b8bb-eed15ff7251f service nova] Releasing lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:26:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.compute.manager [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:26:04 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Creating image(s)
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Ensure instance console log exists: /opt/stack/data/nova/instances/8ec7a046-5c7d-410c-93e4-c991ca9a94f6/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Start _get_guest_xml network_info=[{"id": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "address": "fa:16:3e:5d:e3:e6", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e9c2ec-b0", "ovs_interfaceid": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkgGQAoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8ec7a046-5c7d-410c-93e4-c991ca9a94f6', 'attached_at': '', 'detached_at': '', 'volume_id': '175de249-59e7-4317-8527-f6e649a25950', 'serial': '175de249-59e7-4317-8527-f6e649a25950'}, 'attachment_id': 'e6fd5f99-2f3e-419e-886c-fe0af2b9712c', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:26:04 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:26:04 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkgGQAoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:26:04 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:26:04 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:26:04 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5c91a6-6545-472b-b141-4c0c7023841e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:26:04 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5344387d-b87b-4248-843c-6a6aee9b2fb5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950] added
Apr 11 22:26:04 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3b3e95-e2a3-44c9-8ac6-ce6c02bc7f51]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cae7af5-ef7a-4800-812a-8c274eb58ffa]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xkgGQAoT {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xkgGQAoT" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56cbc79-855f-4fb4-b36c-db57533843e3]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xkgGQAoT'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e56b30d-9f18-496e-b2a0-e5c2943caa8c]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cffb13-a56c-426d-89ca-cd670d7472aa]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 (non-flash)
Apr 11 22:26:04 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 (non-flash)
Apr 11 22:26:04 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad89c0f2-5cec-406c-b7b1-22345094bd04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260]
Apr 11 22:26:04 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260] successful.
Apr 11 22:26:04 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c92d26-896c-434d-bff1-58089b87aa5f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd385623-096e-42dd-8bc2-1bf05df27581]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 (non-flash)
Apr 11 22:26:04 user nova-compute[71364]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:26:04 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 (non-flash)
Apr 11 22:26:04 user nova-compute[71364]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:26:04 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10afcb9-e7d5-48b6-ba9e-d40f736dcc66]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:26:04 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkgGQAoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23831383737363965', 'path': '/dev/sdc'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831383737363965', 'path': '/dev/sdc'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:25:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2062261099',display_name='tempest-TestVolumeBootPattern-server-2062261099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2062261099',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhL8wvIVJR8pmHufcjS+qrhReOn1qW0FZHgyk9N8ASuVVlBrvCVhGiqfOJfs6P4gHo9Wb335OKfNzdYTniAwJX3G5QopUQic2JM2/NmnmU473vWMajYZtI3+7zQVS4dZA==',key_name='tempest-TestVolumeBootPattern-1915615362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-b3uv0lvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:26:00Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=8ec7a046-5c7d-410c-93e4-c991ca9a94f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "address": "fa:16:3e:5d:e3:e6", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e9c2ec-b0", "ovs_interfaceid": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "address": "fa:16:3e:5d:e3:e6", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e9c2ec-b0", "ovs_interfaceid": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e3:e6,bridge_name='br-int',has_traffic_filtering=True,id=84e9c2ec-b042-4069-a1b6-7fb51fc690b8,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e9c2ec-b0') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG nova.objects.instance [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:26:05 user nova-compute[71364]:   <uuid>8ec7a046-5c7d-410c-93e4-c991ca9a94f6</uuid>
Apr 11 22:26:05 user nova-compute[71364]:   <name>instance-0000002e</name>
Apr 11 22:26:05 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:26:05 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:26:05 user nova-compute[71364]:   <metadata>
Apr 11 22:26:05 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:26:05 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:26:05 user nova-compute[71364]:       <nova:name>tempest-TestVolumeBootPattern-server-2062261099</nova:name>
Apr 11 22:26:05 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:26:04</nova:creationTime>
Apr 11 22:26:05 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:26:05 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:26:05 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:26:05 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:26:05 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:26:05 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:26:05 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:26:05 user nova-compute[71364]:       <nova:owner>
Apr 11 22:26:05 user nova-compute[71364]:         <nova:user uuid="4fdb893b6ea3402788a89740355fa935">tempest-TestVolumeBootPattern-1208917682-project-member</nova:user>
Apr 11 22:26:05 user nova-compute[71364]:         <nova:project uuid="eb843e213c594ac28f864550ad68833b">tempest-TestVolumeBootPattern-1208917682</nova:project>
Apr 11 22:26:05 user nova-compute[71364]:       </nova:owner>
Apr 11 22:26:05 user nova-compute[71364]:       <nova:ports>
Apr 11 22:26:05 user nova-compute[71364]:         <nova:port uuid="84e9c2ec-b042-4069-a1b6-7fb51fc690b8">
Apr 11 22:26:05 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 11 22:26:05 user nova-compute[71364]:         </nova:port>
Apr 11 22:26:05 user nova-compute[71364]:       </nova:ports>
Apr 11 22:26:05 user nova-compute[71364]:     </nova:instance>
Apr 11 22:26:05 user nova-compute[71364]:   </metadata>
Apr 11 22:26:05 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:26:05 user nova-compute[71364]:     <system>
Apr 11 22:26:05 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:26:05 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:26:05 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:26:05 user nova-compute[71364]:       <entry name="serial">8ec7a046-5c7d-410c-93e4-c991ca9a94f6</entry>
Apr 11 22:26:05 user nova-compute[71364]:       <entry name="uuid">8ec7a046-5c7d-410c-93e4-c991ca9a94f6</entry>
Apr 11 22:26:05 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:26:05 user nova-compute[71364]:     </system>
Apr 11 22:26:05 user nova-compute[71364]:   </sysinfo>
Apr 11 22:26:05 user nova-compute[71364]:   <os>
Apr 11 22:26:05 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:26:05 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:26:05 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:26:05 user nova-compute[71364]:   </os>
Apr 11 22:26:05 user nova-compute[71364]:   <features>
Apr 11 22:26:05 user nova-compute[71364]:     <acpi/>
Apr 11 22:26:05 user nova-compute[71364]:     <apic/>
Apr 11 22:26:05 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:26:05 user nova-compute[71364]:   </features>
Apr 11 22:26:05 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:26:05 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:26:05 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:26:05 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:26:05 user nova-compute[71364]:   </clock>
Apr 11 22:26:05 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:26:05 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:26:05 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:26:05 user nova-compute[71364]:   </cpu>
Apr 11 22:26:05 user nova-compute[71364]:   <devices>
Apr 11 22:26:05 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 22:26:05 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:26:05 user nova-compute[71364]:       <source dev="/dev/sdc"/>
Apr 11 22:26:05 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:26:05 user nova-compute[71364]:       <serial>175de249-59e7-4317-8527-f6e649a25950</serial>
Apr 11 22:26:05 user nova-compute[71364]:     </disk>
Apr 11 22:26:05 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:26:05 user nova-compute[71364]:       <mac address="fa:16:3e:5d:e3:e6"/>
Apr 11 22:26:05 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:26:05 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:26:05 user nova-compute[71364]:       <target dev="tap84e9c2ec-b0"/>
Apr 11 22:26:05 user nova-compute[71364]:     </interface>
Apr 11 22:26:05 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:26:05 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/8ec7a046-5c7d-410c-93e4-c991ca9a94f6/console.log" append="off"/>
Apr 11 22:26:05 user nova-compute[71364]:     </serial>
Apr 11 22:26:05 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:26:05 user nova-compute[71364]:     <video>
Apr 11 22:26:05 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:26:05 user nova-compute[71364]:     </video>
Apr 11 22:26:05 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:26:05 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:26:05 user nova-compute[71364]:     </rng>
Apr 11 22:26:05 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:26:05 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:26:05 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:26:05 user nova-compute[71364]:     </memballoon>
Apr 11 22:26:05 user nova-compute[71364]:   </devices>
Apr 11 22:26:05 user nova-compute[71364]: </domain>
Apr 11 22:26:05 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:25:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2062261099',display_name='tempest-TestVolumeBootPattern-server-2062261099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2062261099',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhL8wvIVJR8pmHufcjS+qrhReOn1qW0FZHgyk9N8ASuVVlBrvCVhGiqfOJfs6P4gHo9Wb335OKfNzdYTniAwJX3G5QopUQic2JM2/NmnmU473vWMajYZtI3+7zQVS4dZA==',key_name='tempest-TestVolumeBootPattern-1915615362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-b3uv0lvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:26:00Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=8ec7a046-5c7d-410c-93e4-c991ca9a94f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "address": "fa:16:3e:5d:e3:e6", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e9c2ec-b0", "ovs_interfaceid": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "address": "fa:16:3e:5d:e3:e6", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e9c2ec-b0", "ovs_interfaceid": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e3:e6,bridge_name='br-int',has_traffic_filtering=True,id=84e9c2ec-b042-4069-a1b6-7fb51fc690b8,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e9c2ec-b0') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG os_vif [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e3:e6,bridge_name='br-int',has_traffic_filtering=True,id=84e9c2ec-b042-4069-a1b6-7fb51fc690b8,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e9c2ec-b0') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84e9c2ec-b0, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84e9c2ec-b0, col_values=(('external_ids', {'iface-id': '84e9c2ec-b042-4069-a1b6-7fb51fc690b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:e3:e6', 'vm-uuid': '8ec7a046-5c7d-410c-93e4-c991ca9a94f6'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:05 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:26:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:06 user nova-compute[71364]: INFO os_vif [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:e3:e6,bridge_name='br-int',has_traffic_filtering=True,id=84e9c2ec-b042-4069-a1b6-7fb51fc690b8,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e9c2ec-b0')
Apr 11 22:26:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:26:06 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] No VIF found with MAC fa:16:3e:5d:e3:e6, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:26:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-f5bd277f-5388-4909-b4e8-454bd137c037 req-868b7da5-a136-4039-81a9-08eda7879bbb service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Received event network-vif-plugged-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:26:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f5bd277f-5388-4909-b4e8-454bd137c037 req-868b7da5-a136-4039-81a9-08eda7879bbb service nova] Acquiring lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:26:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f5bd277f-5388-4909-b4e8-454bd137c037 req-868b7da5-a136-4039-81a9-08eda7879bbb service nova] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:26:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-f5bd277f-5388-4909-b4e8-454bd137c037 req-868b7da5-a136-4039-81a9-08eda7879bbb service nova] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:26:07 user nova-compute[71364]: DEBUG nova.compute.manager [req-f5bd277f-5388-4909-b4e8-454bd137c037 req-868b7da5-a136-4039-81a9-08eda7879bbb service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] No waiting events found dispatching network-vif-plugged-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:26:07 user nova-compute[71364]: WARNING nova.compute.manager [req-f5bd277f-5388-4909-b4e8-454bd137c037 req-868b7da5-a136-4039-81a9-08eda7879bbb service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Received unexpected event network-vif-plugged-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 for instance with vm_state building and task_state spawning.
Apr 11 22:26:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251969.3726273, 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:26:09 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] VM Resumed (Lifecycle Event)
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:26:09 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Instance spawned successfully.
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:26:09 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681251969.3730965, 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:26:09 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] VM Started (Lifecycle Event)
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:26:09 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:26:09 user nova-compute[71364]: INFO nova.compute.manager [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Took 4.92 seconds to spawn the instance on the hypervisor.
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.compute.manager [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-44ed31ae-cf33-4b1a-82dd-dbe69be3565c req-375fccce-dd1a-4d66-86c7-5ba10cf8dbc4 service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Received event network-vif-plugged-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-44ed31ae-cf33-4b1a-82dd-dbe69be3565c req-375fccce-dd1a-4d66-86c7-5ba10cf8dbc4 service nova] Acquiring lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-44ed31ae-cf33-4b1a-82dd-dbe69be3565c req-375fccce-dd1a-4d66-86c7-5ba10cf8dbc4 service nova] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-44ed31ae-cf33-4b1a-82dd-dbe69be3565c req-375fccce-dd1a-4d66-86c7-5ba10cf8dbc4 service nova] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG nova.compute.manager [req-44ed31ae-cf33-4b1a-82dd-dbe69be3565c req-375fccce-dd1a-4d66-86c7-5ba10cf8dbc4 service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] No waiting events found dispatching network-vif-plugged-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:26:09 user nova-compute[71364]: WARNING nova.compute.manager [req-44ed31ae-cf33-4b1a-82dd-dbe69be3565c req-375fccce-dd1a-4d66-86c7-5ba10cf8dbc4 service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Received unexpected event network-vif-plugged-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 for instance with vm_state building and task_state spawning.
Apr 11 22:26:09 user nova-compute[71364]: INFO nova.compute.manager [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Took 9.74 seconds to build instance.
Apr 11 22:26:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.840s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:26:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:10 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:15 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:26:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:26:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:26:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:26:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:26:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:26:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:26:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:26:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:16 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:26:16 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:26:16 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8542MB free_disk=26.056777954101562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing inventories for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating ProviderTree inventory for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating inventory in ProviderTree for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing aggregate associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, aggregates: None {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing trait associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:26:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:26:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:19 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:26:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:23 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:26:23 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:26:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:25 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:26:25 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:26:25 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Didn't find any instances for network info cache update. {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 22:26:25 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:26:26 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:26:26 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:26:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:27 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:26:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:26:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:30 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:26:30 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:26:30 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:26:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 22:26:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] There are 0 instances to clean {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 22:26:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:32 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:26:32 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71364) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 22:26:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:26:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:26:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:26:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:26:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:26:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:26:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:26:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:01 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:27:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:27:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:27:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:27:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:27:06 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-07f3d13d-aca9-4b9b-836a-aef9d125a5d6 req-7b9424eb-5936-412e-a9fe-45ce348eefac service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-changed-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:27:06 user nova-compute[71364]: DEBUG nova.compute.manager [req-07f3d13d-aca9-4b9b-836a-aef9d125a5d6 req-7b9424eb-5936-412e-a9fe-45ce348eefac service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Refreshing instance network info cache due to event network-changed-53fb131a-4441-4893-8296-1e9ba3a4eef5. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:27:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-07f3d13d-aca9-4b9b-836a-aef9d125a5d6 req-7b9424eb-5936-412e-a9fe-45ce348eefac service nova] Acquiring lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:27:06 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-07f3d13d-aca9-4b9b-836a-aef9d125a5d6 req-7b9424eb-5936-412e-a9fe-45ce348eefac service nova] Acquired lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:27:06 user nova-compute[71364]: DEBUG nova.network.neutron [req-07f3d13d-aca9-4b9b-836a-aef9d125a5d6 req-7b9424eb-5936-412e-a9fe-45ce348eefac service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Refreshing network info cache for port 53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:27:07 user nova-compute[71364]: DEBUG nova.network.neutron [req-07f3d13d-aca9-4b9b-836a-aef9d125a5d6 req-7b9424eb-5936-412e-a9fe-45ce348eefac service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updated VIF entry in instance network info cache for port 53fb131a-4441-4893-8296-1e9ba3a4eef5. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:27:07 user nova-compute[71364]: DEBUG nova.network.neutron [req-07f3d13d-aca9-4b9b-836a-aef9d125a5d6 req-7b9424eb-5936-412e-a9fe-45ce348eefac service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updating instance_info_cache with network_info: [{"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:27:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-07f3d13d-aca9-4b9b-836a-aef9d125a5d6 req-7b9424eb-5936-412e-a9fe-45ce348eefac service nova] Releasing lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:27:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:27:07 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:27:07 user nova-compute[71364]: INFO nova.compute.manager [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Detaching volume 0ab5b289-3649-444b-92ea-2a5d0fd10e21
Apr 11 22:27:07 user nova-compute[71364]: INFO nova.virt.block_device [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Attempting to driver detach volume 0ab5b289-3649-444b-92ea-2a5d0fd10e21 from mountpoint /dev/vdb
Apr 11 22:27:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Attempting to detach device vdb from instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 from the persistent domain config. {{(pid=71364) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 11 22:27:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:27:07 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:27:07 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:27:07 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:27:07 user nova-compute[71364]:   <serial>0ab5b289-3649-444b-92ea-2a5d0fd10e21</serial>
Apr 11 22:27:07 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:27:07 user nova-compute[71364]: </disk>
Apr 11 22:27:07 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:27:07 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Successfully detached device vdb from instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 from the persistent domain config.
Apr 11 22:27:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 from the live domain config. {{(pid=71364) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 11 22:27:07 user nova-compute[71364]: DEBUG nova.virt.libvirt.guest [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] detach device xml: <disk type="block" device="disk">
Apr 11 22:27:07 user nova-compute[71364]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:27:07 user nova-compute[71364]:   <source dev="/dev/sdb"/>
Apr 11 22:27:07 user nova-compute[71364]:   <target dev="vdb" bus="virtio"/>
Apr 11 22:27:07 user nova-compute[71364]:   <serial>0ab5b289-3649-444b-92ea-2a5d0fd10e21</serial>
Apr 11 22:27:07 user nova-compute[71364]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 11 22:27:07 user nova-compute[71364]: </disk>
Apr 11 22:27:07 user nova-compute[71364]:  {{(pid=71364) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Received event <DeviceRemovedEvent: 1681252028.403132, a41689a7-1c45-45b8-8f75-c3f0a655cc18 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71364) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 {{(pid=71364) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 11 22:27:08 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Successfully detached device vdb from instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 from the live domain config.
Apr 11 22:27:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PivwDNnV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:27:08 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d10e38-9212-4df8-849d-ea63589914de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:27:08 user nova-compute[71364]: No targets found.
Apr 11 22:27:08 user nova-compute[71364]: iSNS:
Apr 11 22:27:08 user nova-compute[71364]: No targets found.
Apr 11 22:27:08 user nova-compute[71364]: STATIC:
Apr 11 22:27:08 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21
Apr 11 22:27:08 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:27:08 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:27:08 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950
Apr 11 22:27:08 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:27:08 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:27:08 user nova-compute[71364]: FIRMWARE:
Apr 11 22:27:08 user nova-compute[71364]: No targets found.
Apr 11 22:27:08 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:27:08 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:27:08 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[892847ad-69a1-42e2-8381-d100f9eb6b81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6611543c-a0bf-4584-bb0e-879485c4dba0]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 (non-flash)
Apr 11 22:27:08 user nova-compute[71364]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:27:08 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 (non-flash)
Apr 11 22:27:08 user nova-compute[71364]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:27:08 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacb6aa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[42906694-637c-4fa1-8ce7-959fb13860ea]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e102b2-e95d-4b20-928f-f2e346112c26]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f717fa83-91c1-4941-a2e4-1370ca993d06]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-c1633ec2-039c-4ab4-918a-0e62b8747b9d req-1f6b5286-da9a-45d7-bbd5-a8fcf615382b service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-changed-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG nova.compute.manager [req-c1633ec2-039c-4ab4-918a-0e62b8747b9d req-1f6b5286-da9a-45d7-bbd5-a8fcf615382b service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Refreshing instance network info cache due to event network-changed-53fb131a-4441-4893-8296-1e9ba3a4eef5. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c1633ec2-039c-4ab4-918a-0e62b8747b9d req-1f6b5286-da9a-45d7-bbd5-a8fcf615382b service nova] Acquiring lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c1633ec2-039c-4ab4-918a-0e62b8747b9d req-1f6b5286-da9a-45d7-bbd5-a8fcf615382b service nova] Acquired lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG nova.network.neutron [req-c1633ec2-039c-4ab4-918a-0e62b8747b9d req-1f6b5286-da9a-45d7-bbd5-a8fcf615382b service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Refreshing network info cache for port 53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a82c38-6cae-4cc9-8f95-f0f010f0f1d8]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc400a2-c53a-47bc-b18a-2943cf9ffc2a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89022b2-621b-4138-8211-489bbfb9b00f]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21, portal: 172.16.0.220,3260]
Apr 11 22:27:08 user nova-compute[71364]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21, portal: 172.16.0.220,3260] successful.
Apr 11 22:27:08 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ab5b289-3649-444b-92ea-2a5d0fd10e21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d25f8a7-83d8-4ba4-a6f2-d296d516d8e4]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] <== disconnect_volume: return (312ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:27:08 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:27:09 user nova-compute[71364]: DEBUG nova.network.neutron [req-c1633ec2-039c-4ab4-918a-0e62b8747b9d req-1f6b5286-da9a-45d7-bbd5-a8fcf615382b service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updated VIF entry in instance network info cache for port 53fb131a-4441-4893-8296-1e9ba3a4eef5. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:27:09 user nova-compute[71364]: DEBUG nova.network.neutron [req-c1633ec2-039c-4ab4-918a-0e62b8747b9d req-1f6b5286-da9a-45d7-bbd5-a8fcf615382b service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updating instance_info_cache with network_info: [{"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:27:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-c1633ec2-039c-4ab4-918a-0e62b8747b9d req-1f6b5286-da9a-45d7-bbd5-a8fcf615382b service nova] Releasing lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:27:09 user nova-compute[71364]: DEBUG nova.objects.instance [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'flavor' on Instance uuid a41689a7-1c45-45b8-8f75-c3f0a655cc18 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:27:09 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.888s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:27:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:11 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:13 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:27:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid a41689a7-1c45-45b8-8f75-c3f0a655cc18 {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:27:13 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Triggering sync for uuid 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 {{(pid=71364) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 11 22:27:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:27:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:27:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:27:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:27:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:27:13 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:27:15 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:27:15 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:27:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8649MB free_disk=26.053375244140625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:27:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:27:16 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:27:16 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:27:16 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:27:16 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:27:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:27:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:27:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:27:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:27:16 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:19 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:27:21 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:25 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:27:25 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:27:26 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:27:26 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:27:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:27:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 22:27:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:27:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:27:26 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:27:26 user nova-compute[71364]: DEBUG nova.objects.instance [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lazy-loading 'info_cache' on Instance uuid a41689a7-1c45-45b8-8f75-c3f0a655cc18 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:27:26 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:27:26 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updating instance_info_cache with network_info: [{"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:27:26 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-a41689a7-1c45-45b8-8f75-c3f0a655cc18" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:27:26 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:27:27 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:27:28 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:27:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:27:29 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:31 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:32 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:27:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:46 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:27:50 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-60413cfe-f003-4c9c-ab32-cb240bf14923 req-085f2170-500b-4fcd-8777-3cfe20bcea95 service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Received event network-changed-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:27:51 user nova-compute[71364]: DEBUG nova.compute.manager [req-60413cfe-f003-4c9c-ab32-cb240bf14923 req-085f2170-500b-4fcd-8777-3cfe20bcea95 service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Refreshing instance network info cache due to event network-changed-84e9c2ec-b042-4069-a1b6-7fb51fc690b8. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:27:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-60413cfe-f003-4c9c-ab32-cb240bf14923 req-085f2170-500b-4fcd-8777-3cfe20bcea95 service nova] Acquiring lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:27:51 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-60413cfe-f003-4c9c-ab32-cb240bf14923 req-085f2170-500b-4fcd-8777-3cfe20bcea95 service nova] Acquired lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:27:51 user nova-compute[71364]: DEBUG nova.network.neutron [req-60413cfe-f003-4c9c-ab32-cb240bf14923 req-085f2170-500b-4fcd-8777-3cfe20bcea95 service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Refreshing network info cache for port 84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:27:52 user nova-compute[71364]: DEBUG nova.network.neutron [req-60413cfe-f003-4c9c-ab32-cb240bf14923 req-085f2170-500b-4fcd-8777-3cfe20bcea95 service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Updated VIF entry in instance network info cache for port 84e9c2ec-b042-4069-a1b6-7fb51fc690b8. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:27:52 user nova-compute[71364]: DEBUG nova.network.neutron [req-60413cfe-f003-4c9c-ab32-cb240bf14923 req-085f2170-500b-4fcd-8777-3cfe20bcea95 service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Updating instance_info_cache with network_info: [{"id": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "address": "fa:16:3e:5d:e3:e6", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e9c2ec-b0", "ovs_interfaceid": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:27:52 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-60413cfe-f003-4c9c-ab32-cb240bf14923 req-085f2170-500b-4fcd-8777-3cfe20bcea95 service nova] Releasing lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:27:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "4027e1a8-91f4-464c-bcfb-d35600794092" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:27:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "4027e1a8-91f4-464c-bcfb-d35600794092" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:27:55 user nova-compute[71364]: DEBUG nova.compute.manager [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Starting instance... {{(pid=71364) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 11 22:27:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:27:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:27:55 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71364) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 11 22:27:55 user nova-compute[71364]: INFO nova.compute.claims [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Claim successful on node user
Apr 11 22:27:55 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:27:55 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:27:55 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:27:55 user nova-compute[71364]: DEBUG nova.compute.manager [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Start building networks asynchronously for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 11 22:27:55 user nova-compute[71364]: DEBUG nova.compute.manager [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Allocating IP information in the background. {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 11 22:27:55 user nova-compute[71364]: DEBUG nova.network.neutron [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] allocate_for_instance() {{(pid=71364) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 11 22:27:55 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 11 22:27:55 user nova-compute[71364]: DEBUG nova.compute.manager [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Start building block device mappings for instance. {{(pid=71364) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 11 22:27:56 user nova-compute[71364]: INFO nova.virt.block_device [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Booting with volume fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c at /dev/vda
Apr 11 22:27:56 user nova-compute[71364]: DEBUG nova.policy [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71364) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG os_brick.utils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[00268f32-09fb-4fef-9d1f-28614687eeb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadb6e72-0fd5-4760-9fe5-c5dfd59c32bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62c5dfe-7e34-4071-9201-d2770b112c35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[675b83f3-c58a-4488-979d-b34419b5f638]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Running cmd (subprocess): nvme version {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 'nvme version' failed. Not Retrying. {{(pid=71364) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] nvme not present on system {{(pid=71364) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 11 22:27:56 user nova-compute[71364]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 11 22:27:56 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd9cca4-e431-44e3-8354-93e38b605b42]: (4, '') {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71364) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.lightos [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] LIGHTOS: no hostnqn found. {{(pid=71364) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG os_brick.utils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa9e2a1d2cf9', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:27:56 user nova-compute[71364]: DEBUG nova.virt.block_device [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Updating existing volume attachment record: 2ddc1b4d-033a-4d74-a83f-e81078b028dc {{(pid=71364) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 11 22:27:57 user nova-compute[71364]: DEBUG nova.network.neutron [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Successfully created port: 6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 11 22:27:57 user nova-compute[71364]: DEBUG nova.network.neutron [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Successfully updated port: 6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 11 22:27:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "refresh_cache-4027e1a8-91f4-464c-bcfb-d35600794092" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:27:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquired lock "refresh_cache-4027e1a8-91f4-464c-bcfb-d35600794092" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:27:57 user nova-compute[71364]: DEBUG nova.network.neutron [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Building network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 11 22:27:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-8416af97-b656-43a6-b2e6-09730f957a1e req-1e2d4216-0cbe-47ab-b810-7c8dcb753b39 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Received event network-changed-6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:27:57 user nova-compute[71364]: DEBUG nova.compute.manager [req-8416af97-b656-43a6-b2e6-09730f957a1e req-1e2d4216-0cbe-47ab-b810-7c8dcb753b39 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Refreshing instance network info cache due to event network-changed-6013a9b0-fa3a-48b5-8184-f47631c28f55. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:27:57 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8416af97-b656-43a6-b2e6-09730f957a1e req-1e2d4216-0cbe-47ab-b810-7c8dcb753b39 service nova] Acquiring lock "refresh_cache-4027e1a8-91f4-464c-bcfb-d35600794092" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:27:57 user nova-compute[71364]: DEBUG nova.network.neutron [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Instance cache missing network info. {{(pid=71364) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 11 22:27:58 user nova-compute[71364]: DEBUG nova.network.neutron [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Updating instance_info_cache with network_info: [{"id": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "address": "fa:16:3e:0c:b4:f5", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6013a9b0-fa", "ovs_interfaceid": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:27:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Releasing lock "refresh_cache-4027e1a8-91f4-464c-bcfb-d35600794092" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:27:58 user nova-compute[71364]: DEBUG nova.compute.manager [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Instance network_info: |[{"id": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "address": "fa:16:3e:0c:b4:f5", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6013a9b0-fa", "ovs_interfaceid": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71364) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 11 22:27:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8416af97-b656-43a6-b2e6-09730f957a1e req-1e2d4216-0cbe-47ab-b810-7c8dcb753b39 service nova] Acquired lock "refresh_cache-4027e1a8-91f4-464c-bcfb-d35600794092" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:27:58 user nova-compute[71364]: DEBUG nova.network.neutron [req-8416af97-b656-43a6-b2e6-09730f957a1e req-1e2d4216-0cbe-47ab-b810-7c8dcb753b39 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Refreshing network info cache for port 6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:27:58 user nova-compute[71364]: DEBUG nova.network.neutron [req-8416af97-b656-43a6-b2e6-09730f957a1e req-1e2d4216-0cbe-47ab-b810-7c8dcb753b39 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Updated VIF entry in instance network info cache for port 6013a9b0-fa3a-48b5-8184-f47631c28f55. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:27:58 user nova-compute[71364]: DEBUG nova.network.neutron [req-8416af97-b656-43a6-b2e6-09730f957a1e req-1e2d4216-0cbe-47ab-b810-7c8dcb753b39 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Updating instance_info_cache with network_info: [{"id": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "address": "fa:16:3e:0c:b4:f5", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6013a9b0-fa", "ovs_interfaceid": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:27:58 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-8416af97-b656-43a6-b2e6-09730f957a1e req-1e2d4216-0cbe-47ab-b810-7c8dcb753b39 service nova] Releasing lock "refresh_cache-4027e1a8-91f4-464c-bcfb-d35600794092" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:27:59 user nova-compute[71364]: INFO nova.compute.manager [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Terminating instance
Apr 11 22:27:59 user nova-compute[71364]: DEBUG nova.compute.manager [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-2d1a9a74-df0c-49b7-ae0d-c2f7aaeaeac6 req-827fa93b-cfe7-4329-8f67-3aa0a6fe0039 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-vif-unplugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2d1a9a74-df0c-49b7-ae0d-c2f7aaeaeac6 req-827fa93b-cfe7-4329-8f67-3aa0a6fe0039 service nova] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2d1a9a74-df0c-49b7-ae0d-c2f7aaeaeac6 req-827fa93b-cfe7-4329-8f67-3aa0a6fe0039 service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2d1a9a74-df0c-49b7-ae0d-c2f7aaeaeac6 req-827fa93b-cfe7-4329-8f67-3aa0a6fe0039 service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-2d1a9a74-df0c-49b7-ae0d-c2f7aaeaeac6 req-827fa93b-cfe7-4329-8f67-3aa0a6fe0039 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] No waiting events found dispatching network-vif-unplugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG nova.compute.manager [req-2d1a9a74-df0c-49b7-ae0d-c2f7aaeaeac6 req-827fa93b-cfe7-4329-8f67-3aa0a6fe0039 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-vif-unplugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:27:59 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Instance destroyed successfully.
Apr 11 22:27:59 user nova-compute[71364]: DEBUG nova.objects.instance [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'resources' on Instance uuid a41689a7-1c45-45b8-8f75-c3f0a655cc18 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:23:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-886613326',display_name='tempest-TestMinimumBasicScenario-server-886613326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-886613326',id=44,image_ref='5ebaba51-1209-4bc5-94bd-4d311bd19dd2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLozpT3IVZpFExpqfZ7nWUmsdEQItZHyQVVZzd6wLHQO8XxFS1K2UtCfzqkj67b1mp4lxFDqCmYwQtfgNsNcOcp7JePHFi8MHbM5gfUCCTbQPZaZ7X9hbwKeBgtQjQMuJg==',key_name='tempest-TestMinimumBasicScenario-1734169471',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:23:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c29da1948d84b08acbb7893db590608',ramdisk_id='',reservation_id='r-cwqcq449',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5ebaba51-1209-4bc5-94bd-4d311bd19dd2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1414513068',owner_user_name='tempest-TestMinimumBasicScenario-1414513068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:25:23Z,user_data=None,user_id='e0e3f97050c448deba7ed9dbe0657c77',uuid=a41689a7-1c45-45b8-8f75-c3f0a655cc18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converting VIF {"id": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "address": "fa:16:3e:54:fd:82", "network": {"id": "0266bafd-2189-4e17-bb5c-5d4b81bb7254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-372429751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c29da1948d84b08acbb7893db590608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53fb131a-44", "ovs_interfaceid": "53fb131a-4441-4893-8296-1e9ba3a4eef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:fd:82,bridge_name='br-int',has_traffic_filtering=True,id=53fb131a-4441-4893-8296-1e9ba3a4eef5,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fb131a-44') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG os_vif [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:fd:82,bridge_name='br-int',has_traffic_filtering=True,id=53fb131a-4441-4893-8296-1e9ba3a4eef5,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fb131a-44') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53fb131a-44, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:59 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:27:59 user nova-compute[71364]: INFO os_vif [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:fd:82,bridge_name='br-int',has_traffic_filtering=True,id=53fb131a-4441-4893-8296-1e9ba3a4eef5,network=Network(0266bafd-2189-4e17-bb5c-5d4b81bb7254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53fb131a-44')
Apr 11 22:27:59 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Deleting instance files /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18_del
Apr 11 22:27:59 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Deletion of /opt/stack/data/nova/instances/a41689a7-1c45-45b8-8f75-c3f0a655cc18_del complete
Apr 11 22:27:59 user nova-compute[71364]: INFO nova.compute.manager [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:28:00 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Took 0.65 seconds to deallocate network for instance.
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.compute.manager [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Start spawning the instance on the hypervisor. {{(pid=71364) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Creating instance directory {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 11 22:28:00 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Creating image(s)
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Did not create local disks {{(pid=71364) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Ensure instance console log exists: /opt/stack/data/nova/instances/4027e1a8-91f4-464c-bcfb-d35600794092/console.log {{(pid=71364) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Start _get_guest_xml network_info=[{"id": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "address": "fa:16:3e:0c:b4:f5", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6013a9b0-fa", "ovs_interfaceid": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHuQNamc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4027e1a8-91f4-464c-bcfb-d35600794092', 'attached_at': '', 'detached_at': '', 'volume_id': 'fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c', 'serial': 'fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c'}, 'attachment_id': '2ddc1b4d-033a-4d74-a83f-e81078b028dc', 'mount_device': '/dev/vda', 'boot_index': 0, 'guest_format': None, 'volume_type': None} {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.compute.manager [req-09be765a-1d9f-4d31-83c8-c16c963bcaaa req-461ed69f-aa86-48f5-8c31-60dccdbfa283 service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-vif-deleted-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:28:00 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:28:00 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71364) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-11T21:47:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image limits 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image pref 0:0:0 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71364) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Got 1 possible topologies {{(pid=71364) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71364) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Calling os-brick to attach iSCSI Volume {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHuQNamc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:28:00 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:28:00 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:28:00 user nova-compute[71364]: INFO os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f29f7b-6374-4b6d-a8ba-2690643083bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 11 22:28:00 user nova-compute[71364]:  {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --interface default --op new {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[45827202-38a2-4c35-8f2e-e8ce00adf2e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c] added\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c] added
Apr 11 22:28:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e9df48-b505-4484-b246-8782ed8396ea]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfb30e1-a94c-4459-b505-1d52f908dbb5]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eHuQNamc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eHuQNamc" returned: 0 in 0.023s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d9e53f-0d52-4d99-82d4-4c7bd00a0dec]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eHuQNamc'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[64123b28-510f-40f3-9867-39e805777d5a]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1691bd36-b8a0-49c3-b69c-20700ccd98e4]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:28:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:28:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --login {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:28:00 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Deleted allocations for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[95782b6f-f405-4621-a603-a9601b5686a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c, portal: 172.16.0.220,3260]
Apr 11 22:28:00 user nova-compute[71364]: Login to [iface: default, target: iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c, portal: 172.16.0.220,3260] successful.
Apr 11 22:28:00 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4158fe9-a04b-4f4c-b54f-008361262496]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:28:00 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.855s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e5825a-dcb3-4955-ba75-0e334228e12e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:28:01 user nova-compute[71364]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c (non-flash)
Apr 11 22:28:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:28:01 user nova-compute[71364]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c (non-flash)
Apr 11 22:28:01 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Connected to 172.16.0.220:3260 {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71364) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71364) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9727a9-876d-4972-b68c-1f6bb1a57402]: (4, ('- - 0', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71364) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHuQNamc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71364) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-a2e221b4-656f-4ff9-8f6a-3f14df1bd254 req-b8f5902e-4f63-4c42-8303-37ff4cf4873b service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received event network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a2e221b4-656f-4ff9-8f6a-3f14df1bd254 req-b8f5902e-4f63-4c42-8303-37ff4cf4873b service nova] Acquiring lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a2e221b4-656f-4ff9-8f6a-3f14df1bd254 req-b8f5902e-4f63-4c42-8303-37ff4cf4873b service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-a2e221b4-656f-4ff9-8f6a-3f14df1bd254 req-b8f5902e-4f63-4c42-8303-37ff4cf4873b service nova] Lock "a41689a7-1c45-45b8-8f75-c3f0a655cc18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:28:01 user nova-compute[71364]: DEBUG nova.compute.manager [req-a2e221b4-656f-4ff9-8f6a-3f14df1bd254 req-b8f5902e-4f63-4c42-8303-37ff4cf4873b service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] No waiting events found dispatching network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:28:01 user nova-compute[71364]: WARNING nova.compute.manager [req-a2e221b4-656f-4ff9-8f6a-3f14df1bd254 req-b8f5902e-4f63-4c42-8303-37ff4cf4873b service nova] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Received unexpected event network-vif-plugged-53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance with vm_state deleted and task_state None.
Apr 11 22:28:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26464336231626562', 'path': '/dev/sdb'} {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464336231626562', 'path': '/dev/sdb'} {{(pid=71364) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:27:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1592904077',display_name='tempest-TestVolumeBootPattern-server-1592904077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1592904077',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhL8wvIVJR8pmHufcjS+qrhReOn1qW0FZHgyk9N8ASuVVlBrvCVhGiqfOJfs6P4gHo9Wb335OKfNzdYTniAwJX3G5QopUQic2JM2/NmnmU473vWMajYZtI3+7zQVS4dZA==',key_name='tempest-TestVolumeBootPattern-1915615362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-nbf207sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:27:56Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=4027e1a8-91f4-464c-bcfb-d35600794092,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "address": "fa:16:3e:0c:b4:f5", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6013a9b0-fa", "ovs_interfaceid": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71364) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "address": "fa:16:3e:0c:b4:f5", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6013a9b0-fa", "ovs_interfaceid": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:b4:f5,bridge_name='br-int',has_traffic_filtering=True,id=6013a9b0-fa3a-48b5-8184-f47631c28f55,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6013a9b0-fa') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG nova.objects.instance [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lazy-loading 'pci_devices' on Instance uuid 4027e1a8-91f4-464c-bcfb-d35600794092 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] End _get_guest_xml xml=<domain type="kvm">
Apr 11 22:28:02 user nova-compute[71364]:   <uuid>4027e1a8-91f4-464c-bcfb-d35600794092</uuid>
Apr 11 22:28:02 user nova-compute[71364]:   <name>instance-0000002f</name>
Apr 11 22:28:02 user nova-compute[71364]:   <memory>131072</memory>
Apr 11 22:28:02 user nova-compute[71364]:   <vcpu>1</vcpu>
Apr 11 22:28:02 user nova-compute[71364]:   <metadata>
Apr 11 22:28:02 user nova-compute[71364]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 11 22:28:02 user nova-compute[71364]:       <nova:package version="0.0.0"/>
Apr 11 22:28:02 user nova-compute[71364]:       <nova:name>tempest-TestVolumeBootPattern-server-1592904077</nova:name>
Apr 11 22:28:02 user nova-compute[71364]:       <nova:creationTime>2023-04-11 22:28:00</nova:creationTime>
Apr 11 22:28:02 user nova-compute[71364]:       <nova:flavor name="m1.nano">
Apr 11 22:28:02 user nova-compute[71364]:         <nova:memory>128</nova:memory>
Apr 11 22:28:02 user nova-compute[71364]:         <nova:disk>1</nova:disk>
Apr 11 22:28:02 user nova-compute[71364]:         <nova:swap>0</nova:swap>
Apr 11 22:28:02 user nova-compute[71364]:         <nova:ephemeral>0</nova:ephemeral>
Apr 11 22:28:02 user nova-compute[71364]:         <nova:vcpus>1</nova:vcpus>
Apr 11 22:28:02 user nova-compute[71364]:       </nova:flavor>
Apr 11 22:28:02 user nova-compute[71364]:       <nova:owner>
Apr 11 22:28:02 user nova-compute[71364]:         <nova:user uuid="4fdb893b6ea3402788a89740355fa935">tempest-TestVolumeBootPattern-1208917682-project-member</nova:user>
Apr 11 22:28:02 user nova-compute[71364]:         <nova:project uuid="eb843e213c594ac28f864550ad68833b">tempest-TestVolumeBootPattern-1208917682</nova:project>
Apr 11 22:28:02 user nova-compute[71364]:       </nova:owner>
Apr 11 22:28:02 user nova-compute[71364]:       <nova:ports>
Apr 11 22:28:02 user nova-compute[71364]:         <nova:port uuid="6013a9b0-fa3a-48b5-8184-f47631c28f55">
Apr 11 22:28:02 user nova-compute[71364]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 11 22:28:02 user nova-compute[71364]:         </nova:port>
Apr 11 22:28:02 user nova-compute[71364]:       </nova:ports>
Apr 11 22:28:02 user nova-compute[71364]:     </nova:instance>
Apr 11 22:28:02 user nova-compute[71364]:   </metadata>
Apr 11 22:28:02 user nova-compute[71364]:   <sysinfo type="smbios">
Apr 11 22:28:02 user nova-compute[71364]:     <system>
Apr 11 22:28:02 user nova-compute[71364]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 11 22:28:02 user nova-compute[71364]:       <entry name="product">OpenStack Nova</entry>
Apr 11 22:28:02 user nova-compute[71364]:       <entry name="version">0.0.0</entry>
Apr 11 22:28:02 user nova-compute[71364]:       <entry name="serial">4027e1a8-91f4-464c-bcfb-d35600794092</entry>
Apr 11 22:28:02 user nova-compute[71364]:       <entry name="uuid">4027e1a8-91f4-464c-bcfb-d35600794092</entry>
Apr 11 22:28:02 user nova-compute[71364]:       <entry name="family">Virtual Machine</entry>
Apr 11 22:28:02 user nova-compute[71364]:     </system>
Apr 11 22:28:02 user nova-compute[71364]:   </sysinfo>
Apr 11 22:28:02 user nova-compute[71364]:   <os>
Apr 11 22:28:02 user nova-compute[71364]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 11 22:28:02 user nova-compute[71364]:     <boot dev="hd"/>
Apr 11 22:28:02 user nova-compute[71364]:     <smbios mode="sysinfo"/>
Apr 11 22:28:02 user nova-compute[71364]:   </os>
Apr 11 22:28:02 user nova-compute[71364]:   <features>
Apr 11 22:28:02 user nova-compute[71364]:     <acpi/>
Apr 11 22:28:02 user nova-compute[71364]:     <apic/>
Apr 11 22:28:02 user nova-compute[71364]:     <vmcoreinfo/>
Apr 11 22:28:02 user nova-compute[71364]:   </features>
Apr 11 22:28:02 user nova-compute[71364]:   <clock offset="utc">
Apr 11 22:28:02 user nova-compute[71364]:     <timer name="pit" tickpolicy="delay"/>
Apr 11 22:28:02 user nova-compute[71364]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 11 22:28:02 user nova-compute[71364]:     <timer name="hpet" present="no"/>
Apr 11 22:28:02 user nova-compute[71364]:   </clock>
Apr 11 22:28:02 user nova-compute[71364]:   <cpu mode="custom" match="exact">
Apr 11 22:28:02 user nova-compute[71364]:     <model>Nehalem</model>
Apr 11 22:28:02 user nova-compute[71364]:     <topology sockets="1" cores="1" threads="1"/>
Apr 11 22:28:02 user nova-compute[71364]:   </cpu>
Apr 11 22:28:02 user nova-compute[71364]:   <devices>
Apr 11 22:28:02 user nova-compute[71364]:     <disk type="block" device="disk">
Apr 11 22:28:02 user nova-compute[71364]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 11 22:28:02 user nova-compute[71364]:       <source dev="/dev/sdb"/>
Apr 11 22:28:02 user nova-compute[71364]:       <target dev="vda" bus="virtio"/>
Apr 11 22:28:02 user nova-compute[71364]:       <serial>fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c</serial>
Apr 11 22:28:02 user nova-compute[71364]:     </disk>
Apr 11 22:28:02 user nova-compute[71364]:     <interface type="ethernet">
Apr 11 22:28:02 user nova-compute[71364]:       <mac address="fa:16:3e:0c:b4:f5"/>
Apr 11 22:28:02 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:28:02 user nova-compute[71364]:       <mtu size="1442"/>
Apr 11 22:28:02 user nova-compute[71364]:       <target dev="tap6013a9b0-fa"/>
Apr 11 22:28:02 user nova-compute[71364]:     </interface>
Apr 11 22:28:02 user nova-compute[71364]:     <serial type="pty">
Apr 11 22:28:02 user nova-compute[71364]:       <log file="/opt/stack/data/nova/instances/4027e1a8-91f4-464c-bcfb-d35600794092/console.log" append="off"/>
Apr 11 22:28:02 user nova-compute[71364]:     </serial>
Apr 11 22:28:02 user nova-compute[71364]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 11 22:28:02 user nova-compute[71364]:     <video>
Apr 11 22:28:02 user nova-compute[71364]:       <model type="virtio"/>
Apr 11 22:28:02 user nova-compute[71364]:     </video>
Apr 11 22:28:02 user nova-compute[71364]:     <rng model="virtio">
Apr 11 22:28:02 user nova-compute[71364]:       <backend model="random">/dev/urandom</backend>
Apr 11 22:28:02 user nova-compute[71364]:     </rng>
Apr 11 22:28:02 user nova-compute[71364]:     <controller type="usb" index="0" model="none"/>
Apr 11 22:28:02 user nova-compute[71364]:     <memballoon model="virtio">
Apr 11 22:28:02 user nova-compute[71364]:       <stats period="10"/>
Apr 11 22:28:02 user nova-compute[71364]:     </memballoon>
Apr 11 22:28:02 user nova-compute[71364]:   </devices>
Apr 11 22:28:02 user nova-compute[71364]: </domain>
Apr 11 22:28:02 user nova-compute[71364]:  {{(pid=71364) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:27:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1592904077',display_name='tempest-TestVolumeBootPattern-server-1592904077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1592904077',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhL8wvIVJR8pmHufcjS+qrhReOn1qW0FZHgyk9N8ASuVVlBrvCVhGiqfOJfs6P4gHo9Wb335OKfNzdYTniAwJX3G5QopUQic2JM2/NmnmU473vWMajYZtI3+7zQVS4dZA==',key_name='tempest-TestVolumeBootPattern-1915615362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-nbf207sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-11T22:27:56Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=4027e1a8-91f4-464c-bcfb-d35600794092,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "address": "fa:16:3e:0c:b4:f5", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6013a9b0-fa", "ovs_interfaceid": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "address": "fa:16:3e:0c:b4:f5", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6013a9b0-fa", "ovs_interfaceid": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:b4:f5,bridge_name='br-int',has_traffic_filtering=True,id=6013a9b0-fa3a-48b5-8184-f47631c28f55,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6013a9b0-fa') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG os_vif [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:b4:f5,bridge_name='br-int',has_traffic_filtering=True,id=6013a9b0-fa3a-48b5-8184-f47631c28f55,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6013a9b0-fa') {{(pid=71364) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6013a9b0-fa, may_exist=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6013a9b0-fa, col_values=(('external_ids', {'iface-id': '6013a9b0-fa3a-48b5-8184-f47631c28f55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:b4:f5', 'vm-uuid': '4027e1a8-91f4-464c-bcfb-d35600794092'}),)) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:02 user nova-compute[71364]: INFO os_vif [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:b4:f5,bridge_name='br-int',has_traffic_filtering=True,id=6013a9b0-fa3a-48b5-8184-f47631c28f55,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6013a9b0-fa')
Apr 11 22:28:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] No BDM found with device name vda, not building metadata. {{(pid=71364) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 11 22:28:02 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] No VIF found with MAC fa:16:3e:0c:b4:f5, not building metadata {{(pid=71364) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 11 22:28:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-86a76f3f-09d8-4cd4-b027-84cf89f29833 req-ac6b44e3-a99d-49bc-aded-2bf63052470d service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Received event network-vif-plugged-6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:28:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-86a76f3f-09d8-4cd4-b027-84cf89f29833 req-ac6b44e3-a99d-49bc-aded-2bf63052470d service nova] Acquiring lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:28:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-86a76f3f-09d8-4cd4-b027-84cf89f29833 req-ac6b44e3-a99d-49bc-aded-2bf63052470d service nova] Lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:28:03 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-86a76f3f-09d8-4cd4-b027-84cf89f29833 req-ac6b44e3-a99d-49bc-aded-2bf63052470d service nova] Lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:28:03 user nova-compute[71364]: DEBUG nova.compute.manager [req-86a76f3f-09d8-4cd4-b027-84cf89f29833 req-ac6b44e3-a99d-49bc-aded-2bf63052470d service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] No waiting events found dispatching network-vif-plugged-6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:28:03 user nova-compute[71364]: WARNING nova.compute.manager [req-86a76f3f-09d8-4cd4-b027-84cf89f29833 req-ac6b44e3-a99d-49bc-aded-2bf63052470d service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Received unexpected event network-vif-plugged-6013a9b0-fa3a-48b5-8184-f47631c28f55 for instance with vm_state building and task_state spawning.
Apr 11 22:28:04 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681252085.4977088, 4027e1a8-91f4-464c-bcfb-d35600794092 => Resumed> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:28:05 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] VM Resumed (Lifecycle Event)
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Instance event wait completed in 0 seconds for  {{(pid=71364) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Guest created on hypervisor {{(pid=71364) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 11 22:28:05 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Instance spawned successfully.
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Found default for hw_cdrom_bus of ide {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Found default for hw_disk_bus of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Found default for hw_input_bus of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Found default for hw_pointer_model of None {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Found default for hw_video_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Found default for hw_vif_model of virtio {{(pid=71364) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 11 22:28:05 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.virt.driver [None req-05447c97-6392-4206-9e03-ce397d44908a None None] Emitting event <LifecycleEvent: 1681252085.4988008, 4027e1a8-91f4-464c-bcfb-d35600794092 => Started> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:28:05 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] VM Started (Lifecycle Event)
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71364) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 11 22:28:05 user nova-compute[71364]: INFO nova.compute.manager [None req-05447c97-6392-4206-9e03-ce397d44908a None None] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 11 22:28:05 user nova-compute[71364]: INFO nova.compute.manager [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Took 4.95 seconds to spawn the instance on the hypervisor.
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.compute.manager [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:28:05 user nova-compute[71364]: INFO nova.compute.manager [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Took 10.07 seconds to build instance.
Apr 11 22:28:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "4027e1a8-91f4-464c-bcfb-d35600794092" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.152s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-53c6a52f-431b-4772-ab83-2a2f71e21263 req-3abe6f7a-3cd8-4b17-87bf-2fafc2774d72 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Received event network-vif-plugged-6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-53c6a52f-431b-4772-ab83-2a2f71e21263 req-3abe6f7a-3cd8-4b17-87bf-2fafc2774d72 service nova] Acquiring lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-53c6a52f-431b-4772-ab83-2a2f71e21263 req-3abe6f7a-3cd8-4b17-87bf-2fafc2774d72 service nova] Lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-53c6a52f-431b-4772-ab83-2a2f71e21263 req-3abe6f7a-3cd8-4b17-87bf-2fafc2774d72 service nova] Lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:28:05 user nova-compute[71364]: DEBUG nova.compute.manager [req-53c6a52f-431b-4772-ab83-2a2f71e21263 req-3abe6f7a-3cd8-4b17-87bf-2fafc2774d72 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] No waiting events found dispatching network-vif-plugged-6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:28:05 user nova-compute[71364]: WARNING nova.compute.manager [req-53c6a52f-431b-4772-ab83-2a2f71e21263 req-3abe6f7a-3cd8-4b17-87bf-2fafc2774d72 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Received unexpected event network-vif-plugged-6013a9b0-fa3a-48b5-8184-f47631c28f55 for instance with vm_state active and task_state None.
Apr 11 22:28:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:09 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:14 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681252079.892965, a41689a7-1c45-45b8-8f75-c3f0a655cc18 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:28:14 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] VM Stopped (Lifecycle Event)
Apr 11 22:28:14 user nova-compute[71364]: DEBUG nova.compute.manager [None req-44978baa-2990-4aab-99f2-7db09e2bfb2f None None] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:28:15 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:28:15 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:28:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8680MB free_disk=26.063514709472656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 4027e1a8-91f4-464c-bcfb-d35600794092 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:28:15 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:28:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:28:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:28:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:28:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:28:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:19 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:28:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:24 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:25 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:28:25 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:28:27 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:28:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:28:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:28:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:28:27 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:28:27 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Updating instance_info_cache with network_info: [{"id": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "address": "fa:16:3e:5d:e3:e6", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e9c2ec-b0", "ovs_interfaceid": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:28:27 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:28:27 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:28:28 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:28:28 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:28:28 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:28:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:28:32 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:28:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:28:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:28:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:28:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:28:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:28:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:33 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:28:34 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:28:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:28:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:28:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:28:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:51 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:54 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:28:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:29:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:29:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:29:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:29:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:29:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:29:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:29:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:29:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:29:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:17 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:29:17 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:29:17 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8643MB free_disk=26.092037200927734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 4027e1a8-91f4-464c-bcfb-d35600794092 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:29:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:29:19 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:29:19 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:25 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:29:27 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:29:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:28 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:29:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:29:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 22:29:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:29:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquired lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:29:28 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Forcefully refreshing network info cache for instance {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 11 22:29:28 user nova-compute[71364]: DEBUG nova.objects.instance [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lazy-loading 'info_cache' on Instance uuid 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:29:28 user nova-compute[71364]: DEBUG nova.network.neutron [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Updating instance_info_cache with network_info: [{"id": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "address": "fa:16:3e:5d:e3:e6", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e9c2ec-b0", "ovs_interfaceid": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:29:28 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Releasing lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:29:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Updated the network info_cache for instance {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 11 22:29:28 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:29:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:29:30 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:29:30 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:29:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:29:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:29:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:29:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:29:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:33 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:29:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:29:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:29:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:29:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:29:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-61be3623-9765-4ceb-93c8-5b13ec4bd0ad req-39680f2b-72a9-4233-9d25-7b6d0d175ea0 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Received event network-changed-6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-61be3623-9765-4ceb-93c8-5b13ec4bd0ad req-39680f2b-72a9-4233-9d25-7b6d0d175ea0 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Refreshing instance network info cache due to event network-changed-6013a9b0-fa3a-48b5-8184-f47631c28f55. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-61be3623-9765-4ceb-93c8-5b13ec4bd0ad req-39680f2b-72a9-4233-9d25-7b6d0d175ea0 service nova] Acquiring lock "refresh_cache-4027e1a8-91f4-464c-bcfb-d35600794092" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-61be3623-9765-4ceb-93c8-5b13ec4bd0ad req-39680f2b-72a9-4233-9d25-7b6d0d175ea0 service nova] Acquired lock "refresh_cache-4027e1a8-91f4-464c-bcfb-d35600794092" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG nova.network.neutron [req-61be3623-9765-4ceb-93c8-5b13ec4bd0ad req-39680f2b-72a9-4233-9d25-7b6d0d175ea0 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Refreshing network info cache for port 6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG nova.network.neutron [req-61be3623-9765-4ceb-93c8-5b13ec4bd0ad req-39680f2b-72a9-4233-9d25-7b6d0d175ea0 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Updated VIF entry in instance network info cache for port 6013a9b0-fa3a-48b5-8184-f47631c28f55. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG nova.network.neutron [req-61be3623-9765-4ceb-93c8-5b13ec4bd0ad req-39680f2b-72a9-4233-9d25-7b6d0d175ea0 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Updating instance_info_cache with network_info: [{"id": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "address": "fa:16:3e:0c:b4:f5", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6013a9b0-fa", "ovs_interfaceid": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-61be3623-9765-4ceb-93c8-5b13ec4bd0ad req-39680f2b-72a9-4233-9d25-7b6d0d175ea0 service nova] Releasing lock "refresh_cache-4027e1a8-91f4-464c-bcfb-d35600794092" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-2e8be7b9-352d-42ae-8e33-adfa523b7a31 req-4315d7b5-87a3-477a-8973-1277def7a3d9 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Received event network-changed-6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG nova.compute.manager [req-2e8be7b9-352d-42ae-8e33-adfa523b7a31 req-4315d7b5-87a3-477a-8973-1277def7a3d9 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Refreshing instance network info cache due to event network-changed-6013a9b0-fa3a-48b5-8184-f47631c28f55. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2e8be7b9-352d-42ae-8e33-adfa523b7a31 req-4315d7b5-87a3-477a-8973-1277def7a3d9 service nova] Acquiring lock "refresh_cache-4027e1a8-91f4-464c-bcfb-d35600794092" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2e8be7b9-352d-42ae-8e33-adfa523b7a31 req-4315d7b5-87a3-477a-8973-1277def7a3d9 service nova] Acquired lock "refresh_cache-4027e1a8-91f4-464c-bcfb-d35600794092" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:29:47 user nova-compute[71364]: DEBUG nova.network.neutron [req-2e8be7b9-352d-42ae-8e33-adfa523b7a31 req-4315d7b5-87a3-477a-8973-1277def7a3d9 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Refreshing network info cache for port 6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "4027e1a8-91f4-464c-bcfb-d35600794092" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "4027e1a8-91f4-464c-bcfb-d35600794092" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:29:48 user nova-compute[71364]: INFO nova.compute.manager [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Terminating instance
Apr 11 22:29:48 user nova-compute[71364]: DEBUG nova.compute.manager [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG nova.network.neutron [req-2e8be7b9-352d-42ae-8e33-adfa523b7a31 req-4315d7b5-87a3-477a-8973-1277def7a3d9 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Updated VIF entry in instance network info cache for port 6013a9b0-fa3a-48b5-8184-f47631c28f55. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG nova.network.neutron [req-2e8be7b9-352d-42ae-8e33-adfa523b7a31 req-4315d7b5-87a3-477a-8973-1277def7a3d9 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Updating instance_info_cache with network_info: [{"id": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "address": "fa:16:3e:0c:b4:f5", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6013a9b0-fa", "ovs_interfaceid": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-2e8be7b9-352d-42ae-8e33-adfa523b7a31 req-4315d7b5-87a3-477a-8973-1277def7a3d9 service nova] Releasing lock "refresh_cache-4027e1a8-91f4-464c-bcfb-d35600794092" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:29:48 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Instance destroyed successfully.
Apr 11 22:29:48 user nova-compute[71364]: DEBUG nova.objects.instance [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lazy-loading 'resources' on Instance uuid 4027e1a8-91f4-464c-bcfb-d35600794092 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:27:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1592904077',display_name='tempest-TestVolumeBootPattern-server-1592904077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1592904077',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhL8wvIVJR8pmHufcjS+qrhReOn1qW0FZHgyk9N8ASuVVlBrvCVhGiqfOJfs6P4gHo9Wb335OKfNzdYTniAwJX3G5QopUQic2JM2/NmnmU473vWMajYZtI3+7zQVS4dZA==',key_name='tempest-TestVolumeBootPattern-1915615362',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:28:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-nbf207sh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:28:06Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=4027e1a8-91f4-464c-bcfb-d35600794092,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "address": "fa:16:3e:0c:b4:f5", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6013a9b0-fa", "ovs_interfaceid": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "address": "fa:16:3e:0c:b4:f5", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6013a9b0-fa", "ovs_interfaceid": "6013a9b0-fa3a-48b5-8184-f47631c28f55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:b4:f5,bridge_name='br-int',has_traffic_filtering=True,id=6013a9b0-fa3a-48b5-8184-f47631c28f55,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6013a9b0-fa') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG os_vif [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:b4:f5,bridge_name='br-int',has_traffic_filtering=True,id=6013a9b0-fa3a-48b5-8184-f47631c28f55,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6013a9b0-fa') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6013a9b0-fa, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:48 user nova-compute[71364]: INFO os_vif [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:b4:f5,bridge_name='br-int',has_traffic_filtering=True,id=6013a9b0-fa3a-48b5-8184-f47631c28f55,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6013a9b0-fa')
Apr 11 22:29:48 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eHuQNamc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:29:48 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:29:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c44ca11-e51c-45cf-a57a-b681401d9a51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:29:48 user nova-compute[71364]: No targets found.
Apr 11 22:29:48 user nova-compute[71364]: iSNS:
Apr 11 22:29:48 user nova-compute[71364]: No targets found.
Apr 11 22:29:48 user nova-compute[71364]: STATIC:
Apr 11 22:29:48 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c
Apr 11 22:29:48 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:29:48 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:29:48 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950
Apr 11 22:29:48 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:29:48 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:29:48 user nova-compute[71364]: FIRMWARE:
Apr 11 22:29:48 user nova-compute[71364]: No targets found.
Apr 11 22:29:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:29:48 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:29:48 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f63341-a632-49ed-bb41-6ce289ecce4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf338e9-f9be-42dc-9072-86753b8379e3]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:29:48 user nova-compute[71364]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c (non-flash)
Apr 11 22:29:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:29:48 user nova-compute[71364]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c (non-flash)
Apr 11 22:29:48 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacff28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c'): ({'sdb'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Removing single pathed devices sdb {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bf068e-c3cb-4708-b273-a13049a33b87]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a170803-520d-423c-9534-b2842068c0d2]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flushing IO for device /dev/sdb {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc42894-8511-4f5b-a270-6bde2e20176f]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:29:48 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d47c1c-9799-4b43-aff8-30077c4e67f1]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] SCSI volumes sdb have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5545bf53-99af-4a40-b1f6-03ee7dc5ec85]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b806df95-d6f3-4905-b11e-4ea4fcbcb0e6]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c, portal: 172.16.0.220,3260]
Apr 11 22:29:49 user nova-compute[71364]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c, portal: 172.16.0.220,3260] successful.
Apr 11 22:29:49 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cbd759-5685-4113-b1ed-21f82e6b83b7]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== disconnect_volume: return (311ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:29:49 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Deleting instance files /opt/stack/data/nova/instances/4027e1a8-91f4-464c-bcfb-d35600794092_del
Apr 11 22:29:49 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Deletion of /opt/stack/data/nova/instances/4027e1a8-91f4-464c-bcfb-d35600794092_del complete
Apr 11 22:29:49 user nova-compute[71364]: INFO nova.compute.manager [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 11 22:29:49 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:29:49 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Took 0.42 seconds to deallocate network for instance.
Apr 11 22:29:49 user nova-compute[71364]: DEBUG nova.compute.manager [req-ab7513cc-bb68-409b-9e3f-60f4e89fd2a9 req-e8d55f51-7171-4f9f-8bf7-4b7d790c884d service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Received event network-vif-deleted-6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:29:49 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Received event network-vif-unplugged-6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] Acquiring lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] Lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] Lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] No waiting events found dispatching network-vif-unplugged-6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Received event network-vif-unplugged-6013a9b0-fa3a-48b5-8184-f47631c28f55 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Received event network-vif-plugged-6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] Acquiring lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] Lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] Lock "4027e1a8-91f4-464c-bcfb-d35600794092-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG nova.compute.manager [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] No waiting events found dispatching network-vif-plugged-6013a9b0-fa3a-48b5-8184-f47631c28f55 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:29:50 user nova-compute[71364]: WARNING nova.compute.manager [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Received unexpected event network-vif-plugged-6013a9b0-fa3a-48b5-8184-f47631c28f55 for instance with vm_state active and task_state deleting.
Apr 11 22:29:50 user nova-compute[71364]: INFO nova.compute.manager [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Took 0.79 seconds to detach 1 volumes for instance.
Apr 11 22:29:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:29:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:29:50 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Deleted allocations for instance 4027e1a8-91f4-464c-bcfb-d35600794092
Apr 11 22:29:50 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "4027e1a8-91f4-464c-bcfb-d35600794092" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.662s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:29:53 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:29:58 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:30:03 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681252188.8124518, 4027e1a8-91f4-464c-bcfb-d35600794092 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:30:03 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] VM Stopped (Lifecycle Event)
Apr 11 22:30:03 user nova-compute[71364]: DEBUG nova.compute.manager [None req-1864c825-b6d0-4327-bc07-1a30525e8c38 None None] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:30:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:30:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:30:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:30:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:30:03 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:08 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:13 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71364) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 11 22:30:17 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:30:17 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:30:17 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8774MB free_disk=26.09095001220703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71364) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:30:17 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:30:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:30:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:30:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:30:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:30:18 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:21 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:30:23 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:30:25 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:30:27 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:30:28 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:30:28 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:30:28 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:30:30 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:30:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:30:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Didn't find any instances for network info cache update. {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 22:30:32 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:30:32 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:30:33 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:30:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:30:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:30:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:30:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:30:33 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:30:38 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:30:38 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-0d54b315-3aae-4c6e-a24e-574baee87099 req-b39d7106-edd1-4951-8dd1-e7e96f2ec6cc service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Received event network-changed-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG nova.compute.manager [req-0d54b315-3aae-4c6e-a24e-574baee87099 req-b39d7106-edd1-4951-8dd1-e7e96f2ec6cc service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Refreshing instance network info cache due to event network-changed-84e9c2ec-b042-4069-a1b6-7fb51fc690b8. {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0d54b315-3aae-4c6e-a24e-574baee87099 req-b39d7106-edd1-4951-8dd1-e7e96f2ec6cc service nova] Acquiring lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0d54b315-3aae-4c6e-a24e-574baee87099 req-b39d7106-edd1-4951-8dd1-e7e96f2ec6cc service nova] Acquired lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG nova.network.neutron [req-0d54b315-3aae-4c6e-a24e-574baee87099 req-b39d7106-edd1-4951-8dd1-e7e96f2ec6cc service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Refreshing network info cache for port 84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:30:41 user nova-compute[71364]: INFO nova.compute.manager [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Terminating instance
Apr 11 22:30:41 user nova-compute[71364]: DEBUG nova.compute.manager [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Start destroying the instance on the hypervisor. {{(pid=71364) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG nova.network.neutron [req-0d54b315-3aae-4c6e-a24e-574baee87099 req-b39d7106-edd1-4951-8dd1-e7e96f2ec6cc service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Updated VIF entry in instance network info cache for port 84e9c2ec-b042-4069-a1b6-7fb51fc690b8. {{(pid=71364) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG nova.network.neutron [req-0d54b315-3aae-4c6e-a24e-574baee87099 req-b39d7106-edd1-4951-8dd1-e7e96f2ec6cc service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Updating instance_info_cache with network_info: [{"id": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "address": "fa:16:3e:5d:e3:e6", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e9c2ec-b0", "ovs_interfaceid": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:30:41 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-0d54b315-3aae-4c6e-a24e-574baee87099 req-b39d7106-edd1-4951-8dd1-e7e96f2ec6cc service nova] Releasing lock "refresh_cache-8ec7a046-5c7d-410c-93e4-c991ca9a94f6" {{(pid=71364) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 11 22:30:42 user nova-compute[71364]: INFO nova.virt.libvirt.driver [-] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Instance destroyed successfully.
Apr 11 22:30:42 user nova-compute[71364]: DEBUG nova.objects.instance [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lazy-loading 'resources' on Instance uuid 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 {{(pid=71364) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.vif [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-11T22:25:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2062261099',display_name='tempest-TestVolumeBootPattern-server-2062261099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2062261099',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhL8wvIVJR8pmHufcjS+qrhReOn1qW0FZHgyk9N8ASuVVlBrvCVhGiqfOJfs6P4gHo9Wb335OKfNzdYTniAwJX3G5QopUQic2JM2/NmnmU473vWMajYZtI3+7zQVS4dZA==',key_name='tempest-TestVolumeBootPattern-1915615362',keypairs=<?>,launch_index=0,launched_at=2023-04-11T22:26:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb843e213c594ac28f864550ad68833b',ramdisk_id='',reservation_id='r-b3uv0lvr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1208917682',owner_user_name='tempest-TestVolumeBootPattern-1208917682-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-11T22:26:10Z,user_data=None,user_id='4fdb893b6ea3402788a89740355fa935',uuid=8ec7a046-5c7d-410c-93e4-c991ca9a94f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "address": "fa:16:3e:5d:e3:e6", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e9c2ec-b0", "ovs_interfaceid": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converting VIF {"id": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "address": "fa:16:3e:5d:e3:e6", "network": {"id": "3ce90985-b838-465c-812d-53d09eed560d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1424949532-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb843e213c594ac28f864550ad68833b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e9c2ec-b0", "ovs_interfaceid": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG nova.network.os_vif_util [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:e3:e6,bridge_name='br-int',has_traffic_filtering=True,id=84e9c2ec-b042-4069-a1b6-7fb51fc690b8,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e9c2ec-b0') {{(pid=71364) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_vif [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:e3:e6,bridge_name='br-int',has_traffic_filtering=True,id=84e9c2ec-b042-4069-a1b6-7fb51fc690b8,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e9c2ec-b0') {{(pid=71364) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84e9c2ec-b0, bridge=br-int, if_exists=True) {{(pid=71364) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:30:42 user nova-compute[71364]: INFO os_vif [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:e3:e6,bridge_name='br-int',has_traffic_filtering=True,id=84e9c2ec-b042-4069-a1b6-7fb51fc690b8,network=Network(3ce90985-b838-465c-812d-53d09eed560d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e9c2ec-b0')
Apr 11 22:30:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] calling os-brick to detach iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4bace3a0b0>, {'target_iqn': 'iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkgGQAoT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 11 22:30:42 user nova-compute[71364]: WARNING os_brick.initiator.connectors.base [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d005e8-3ccc-4c23-adea-cd76882ece39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 11 22:30:42 user nova-compute[71364]: No targets found.
Apr 11 22:30:42 user nova-compute[71364]: iSNS:
Apr 11 22:30:42 user nova-compute[71364]: No targets found.
Apr 11 22:30:42 user nova-compute[71364]: STATIC:
Apr 11 22:30:42 user nova-compute[71364]: Target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950
Apr 11 22:30:42 user nova-compute[71364]:         Portal: 172.16.0.220:3260,-1
Apr 11 22:30:42 user nova-compute[71364]:                 Iface Name: default
Apr 11 22:30:42 user nova-compute[71364]: FIRMWARE:
Apr 11 22:30:42 user nova-compute[71364]: No targets found.
Apr 11 22:30:42 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 11 22:30:42 user nova-compute[71364]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 11 22:30:42 user nova-compute[71364]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71364) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950', 0)] {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d3d884-4f55-49c6-818b-938bca6154b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4059d85-e5a1-4d41-bd8a-14d0bedb42ba]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:30:42 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 (non-flash)
Apr 11 22:30:42 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4bacc76290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950'): ({'sdc'}, set())}) {{(pid=71364) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Removing single pathed devices sdc {{(pid=71364) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afd299b-a382-4cd6-9485-05fa88a28afc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa3cef0-1e32-4f89-a412-1fd087cd1672]: (4, ('ok\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flushing IO for device /dev/sdc {{(pid=71364) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[80500d20-1c7a-4270-bb30-429b9723a019]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71364) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ed7bac-d951-4e9a-87c3-cf9271852db5]: (4, ('1', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.linuxscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] SCSI volumes sdc have been removed. {{(pid=71364) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23831383737363965', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f2924e5c', '/dev/disk/by-id/scsi-1SCST_BIOf2924e5c-8187769e58698bee') {{(pid=81576) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46d1eb6-ae83-499e-a0f4-8c4adac8ca93]: (4, None) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950')] {{(pid=71364) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb180f3-e51a-4212-9ae7-25f301be0397]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --logout {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5feedd-6aa9-41cc-a8fc-4822b6dce8b5]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260]
Apr 11 22:30:42 user nova-compute[71364]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950, portal: 172.16.0.220,3260] successful.
Apr 11 22:30:42 user nova-compute[71364]:  stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op delete {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:175de249-59e7-4317-8527-f6e649a25950 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=81576) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5539f64-4157-4e6d-a450-9e2d0c10162d]: (4, ('', '')) {{(pid=81576) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71364) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.base [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] <== disconnect_volume: return (315ms) None {{(pid=71364) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Disconnected iSCSI Volume {{(pid=71364) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 11 22:30:42 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Deleting instance files /opt/stack/data/nova/instances/8ec7a046-5c7d-410c-93e4-c991ca9a94f6_del
Apr 11 22:30:42 user nova-compute[71364]: INFO nova.virt.libvirt.driver [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Deletion of /opt/stack/data/nova/instances/8ec7a046-5c7d-410c-93e4-c991ca9a94f6_del complete
Apr 11 22:30:42 user nova-compute[71364]: INFO nova.compute.manager [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 11 22:30:42 user nova-compute[71364]: DEBUG oslo.service.loopingcall [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71364) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG nova.compute.manager [-] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Deallocating network for instance {{(pid=71364) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 11 22:30:42 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] deallocate_for_instance() {{(pid=71364) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 11 22:30:43 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:43 user nova-compute[71364]: DEBUG nova.network.neutron [-] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Updating instance_info_cache with network_info: [] {{(pid=71364) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 11 22:30:43 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Took 0.46 seconds to deallocate network for instance.
Apr 11 22:30:43 user nova-compute[71364]: DEBUG nova.compute.manager [req-b244aad2-e660-47b5-9e92-7d00b48cd5b0 req-d391c298-aa51-4219-8c46-a9a35d39299d service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Received event network-vif-deleted-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:30:43 user nova-compute[71364]: DEBUG nova.compute.manager [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Received event network-vif-unplugged-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:30:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] Acquiring lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:30:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:30:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:30:43 user nova-compute[71364]: DEBUG nova.compute.manager [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] No waiting events found dispatching network-vif-unplugged-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:30:43 user nova-compute[71364]: DEBUG nova.compute.manager [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Received event network-vif-unplugged-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 for instance with task_state deleting. {{(pid=71364) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 11 22:30:43 user nova-compute[71364]: DEBUG nova.compute.manager [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Received event network-vif-plugged-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 11 22:30:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] Acquiring lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:30:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:30:43 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:30:43 user nova-compute[71364]: DEBUG nova.compute.manager [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] No waiting events found dispatching network-vif-plugged-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 {{(pid=71364) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 11 22:30:43 user nova-compute[71364]: WARNING nova.compute.manager [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Received unexpected event network-vif-plugged-84e9c2ec-b042-4069-a1b6-7fb51fc690b8 for instance with vm_state active and task_state deleting.
Apr 11 22:30:44 user nova-compute[71364]: INFO nova.compute.manager [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Took 0.96 seconds to detach 1 volumes for instance.
Apr 11 22:30:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:30:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:30:44 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:30:44 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:30:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:30:44 user nova-compute[71364]: INFO nova.scheduler.client.report [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Deleted allocations for instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6
Apr 11 22:30:44 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "8ec7a046-5c7d-410c-93e4-c991ca9a94f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.862s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:30:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:30:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:30:57 user nova-compute[71364]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681252242.1644893, 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 => Stopped> {{(pid=71364) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 11 22:30:57 user nova-compute[71364]: INFO nova.compute.manager [-] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] VM Stopped (Lifecycle Event)
Apr 11 22:30:57 user nova-compute[71364]: DEBUG nova.compute.manager [None req-24255c59-9ddd-48e7-87cd-d9fd759871a7 None None] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Checking state {{(pid=71364) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 11 22:30:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:31:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:31:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:31:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:31:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:31:18 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:31:18 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:31:18 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8862MB free_disk=26.090049743652344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing inventories for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating ProviderTree inventory for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Updating inventory in ProviderTree for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing aggregate associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, aggregates: None {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Refreshing trait associations for resource provider c1fc3d49-a748-458e-8eba-ee7803982ec7, traits: COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE42 {{(pid=71364) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:31:18 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:31:19 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:31:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:31:22 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:31:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:31:25 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:31:25 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:31:27 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:31:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:31:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:31:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:31:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:31:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:31:27 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:31:30 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:31:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Starting heal instance info cache {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 11 22:31:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Rebuilding the list of instances to heal {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 11 22:31:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Didn't find any instances for network info cache update. {{(pid=71364) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 11 22:31:30 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:31:30 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71364) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 11 22:31:32 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:31:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:31:32 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:31:33 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:31:35 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:31:36 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:31:37 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:31:39 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:31:40 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:31:40 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 11 22:31:40 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] There are 0 instances to clean {{(pid=71364) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 11 22:31:42 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:31:42 user nova-compute[71364]: DEBUG nova.compute.manager [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71364) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 11 22:31:42 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:31:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:31:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:31:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:31:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:31:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:31:47 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:31:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:31:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:31:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:31:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:31:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:31:52 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:31:57 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:32:02 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:32:07 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:32:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:32:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:32:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71364) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 11 22:32:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:32:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71364) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 11 22:32:12 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:32:17 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 11 22:32:19 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:32:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:32:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:32:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:32:19 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Auditing locally available compute resources for user (node: user) {{(pid=71364) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 11 22:32:19 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:32:19 user nova-compute[71364]: WARNING nova.virt.libvirt.driver [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 11 22:32:19 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=26.087364196777344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=71364) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 11 22:32:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 11 22:32:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 11 22:32:19 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 11 22:32:19 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71364) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 11 22:32:19 user nova-compute[71364]: DEBUG nova.compute.provider_tree [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed in ProviderTree for provider: c1fc3d49-a748-458e-8eba-ee7803982ec7 {{(pid=71364) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 11 22:32:19 user nova-compute[71364]: DEBUG nova.scheduler.client.report [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Inventory has not changed for provider c1fc3d49-a748-458e-8eba-ee7803982ec7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71364) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 11 22:32:19 user nova-compute[71364]: DEBUG nova.compute.resource_tracker [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Compute_service record updated for user:user {{(pid=71364) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 11 22:32:19 user nova-compute[71364]: DEBUG oslo_concurrency.lockutils [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.106s {{(pid=71364) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 11 22:32:22 user nova-compute[71364]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71364) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 11 22:32:23 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:32:27 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 11 22:32:27 user nova-compute[71364]: DEBUG oslo_service.periodic_task [None req-346d89a0-fa6b-4948-959e-652251277a96 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71364) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}